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Abstract 

The Multidimensional Assignment Problem (MAP) (abbreviated s-AP in the case of s dimensions) is an extension of 
the well-known assignment problem. The most studied case of MAP is 3-AP, though the problems with larger values 
of s also have a large number of applications. We consider several known neighborhoods, generalize them and propose 
some new ones. The heuristics are evaluated both theoretically and experimentally and dominating algorithms are 
selected. We also demonstrate a combination of two neighborhoods may yield a heuristics which is superior to both of 
its components. 
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1 Introduction 

The Multidimensional Assignment Problem (MAP) (abbreviated s-AP in the case of s dimensions, also 
called (axial) Multi Index Assignment Problem, MIAP, |5, 29 1) is a well-known optimization problem. It is 
an extension of the Assignment Problem (AP), which is exactly the two dimensional case of MAP. While AP 
can be solved in the polynomial time ll25ll . s-AP for every s > 3 is NP-hard lfl3l and inapproximable 1 9 01 
The most studied case of MAP is the case of three dimensions |fl] [5] 0] QT| [20] [37) though the problem 
has a host of applications for higher numbers of dimensions, e.g., in matching information from several 
sensors (data association problem), which arises in plane tracking Il27ll30l . computer vision [39] and some 
others 0[5][7), in routing in meshes [5], tracking elementary particles 11331 . solving systems of polynomial 
equations |6], image recognition Ifl4l . resource allocation [ 14|, etc. 

For a fixed s > 2, the problem s-AP is stated as follows. Let X\ = X2 = . . . = X s = {1, 2, . . . , n}. 
We will consider only vectors that belong to the Cartesian product X = X\ x X2 X . . . X X s . Each 
vector e 6 lis assigned a non-negative weight w(e). For a vector e € X, the component ej denotes 
its jth coordinate, i.e., ej € Xj. A collection A of t < n vectors A 1 , A 2 , . . . , A* is a (feasible) partial 
assignment if Aj ^ Aj holds for each i k and j G {1,2,..., s}. The weight of a partial assignment A 
is w(A) = Yli=i w(A l ). An assignment (or full assignment) is a partial assignment with n vectors. The 
objective of s-AP is to find an assignment of minimal weight. 



*A preliminary version of this paper was published in Golumbic Festschrift, volume 5420 of Lect. Notes Comput. Sci., pages 
100-115, Springer, 2009. 
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1 Burkard et al. show it for a special case of 3-AP and since 3-AP is a special case of s-AP the result can be extended to the general 
MAP 
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We also provide a permutation form of the assignment which is sometimes more convenient. Let 
iv i, 7T2, . . . , 7r s be permutations of X\, X%, . . . ,X S respectively. Then 7Ti7T2 . . . tt s is an assignment with 
the weight Yh=i w(-Ki(i)TT 2 {i) . . . n s (i)). 

It is obvious that one permutation, say the first one, may be fixed without any loss of generality: = 
l n , where 1„ is the identity permutation of size n. Then the objective of the problem is as follows: 



min \ w(ini(i) . . . n s (i)) 

i 7T„ ' * 



7T2,...,7T_ 

i=l 



A graph formulation of the problem is as follows. Having an s-partite graph G with parts X%, X2, ■ ■ ■ , 
X s , where \Xi\ = n, find a set of n disjoint cliques in G of the minimal total weight if every clique e in G 
is assigned a weight w(e). 

Finally, an integer programming formulation of the problem is as follows. 



min 2J w{ii . . . i s ) ■ Xi x ...i 

i 1 ex 1 ,...A s ex s 



subject to 



E 



i 2 ex 2 ,...,i,ex s 



E 



= 1 Vii G Xi 



= 1 Vt s e x s 



i 1 eX 1 ,...,i s _ 1 GX 3 



where Xi 1 ..4 e G {0, 1} for all %\, . .., i s and \X\\ = . . . = \X S \ = n. 

Sometimes the problem is formulated in a more general way if \X\ \ — n\, X 2 | = rt2, . . . , \X S \ = n s 
and the requirement m = ri2 = . ■ ■ = n s is omitted. However this case can be easily transformed into the 
problem described above by complementing the weight matrix toannxnx...xn matrix with zeros, 
where n = max, n;. 

The problem was studied by many researchers. Several special cases of the problem were intensively 
studied in the literature (see [26 1 and references there) and for few classes of instances polynomial time 
exact algorithms were found, see, e.g., |H1[9]|2T|. In many cases MAP remains hard to solve ll26l[36l . For 
example, if there are three sets of points of size n on a Euclidean plain and the objective is to find n triples 
of points, one from each set, such that the total circumference or area of the corresponding triangles is 
minimal, the corresponding 3-AP is still NP-hard [36|. The asymptotic properties of some special instance 
families are studied in |[T4l . 

As regards the solution methods, apart from exact and approximation algorithms Pfl [TT1 l26l [3T1 [32l . 
several heuristics including construction heuristics ||4][T6]|23]|28), greedy randomized adaptive search pro- 
cedures |[Tl [27ll28l[35ll , metaheuristics |T0l[20ll and parallel heuristics ||28l are presented in the literature. 
Several local search procedures are proposed and discussed in ffl|4ll5ll9l [T0ll20ll28ll3"5l . 

The difference between the construction heuristics and local search is sometimes crucial. While a 
construction heuristic generates a solution from scratch and, thus, has some solution quality limitation, 
local search is intended to improve an existing solution and, thus, can be used after a construction heuristic 
or as a part of a more sophisticated heuristic, so called metaheuristic. 

The contribution of our paper is in collecting and generalizing all local search heuristics known from 
the literature, proposing some new ones and detailed theoretical and evaluating them both theoretically and 
experimentally. For the purpose of experimental evaluation we also thoroughly discuss, classify the existing 
instance families and propose some new ones. 
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In this paper we consider only the general case of MAP and, thus, all the heuristics which rely on the 
special structures of the weight matrix are not included in the comparison. We also assume that the number 
of dimensions s is a small fixed constant while the size n can be arbitrary large. 



2 Heuristics 

In this section we discuss some well known and some new MAP local search heuristics as well as their 
combinations. 



2.1 Dimensionwise Variations Heuristics 

The heuristics of this group were first introduced by Bandelt et al. [5 1 for MAP with decomposable costs. 
However, having a very large neighborhood (see below), they are very efficient even in the general case. 
The fact that this approach was also used by Huang and Lim as a local search procedure for their memetic 
algorithm [20| confirms its efficiency. 

The idea of the dimensionwise variation heuristics is as follows. Consider the initial assignment A in 
the permutation form A = ttiit2 ■ ■ ■ tt s (see SectionQ]i. Let p(A, pi, p2, ■ . . , p s ) be an assignment obtained 
from A by applying the permutations pi, p2, . . . , p s to 7Ti, 7T2, . . . , n s respectively: 

p(A,p 1 ,p 2 , ...,p s ) = pi(ir 1 )p 2 (TT 2 ) . . .p s (vr s ) . (1) 

Let pd(A, p) be an assignment p(A, pi, p 2 , ■ ■ ■ , p s ), where pj = p if j e D and pj = 1„ otherwise (1„ is 
the identity permutation of size n): 

p D {A,p)= P (AM if } eD > « 2 ^ D ,..> «° eD ) . (2) 
y y \ \l n otherwise [1„ otherwise' ' [1„ otherwise J 

On every iteration, the heuristic selects some nonempty set D C {1, 2, . . . , s} of dimensions and searches 
for a permutation p such that w(pd(A, p)) is minimized. 

For every subset of dimensions D, there are n! different permutations p but the optimal one can be 
found in the polynomial time. Let swap(u, v, D) be a vector which is equal to vector u in all dimensions 
j G {1, 2, . . . , s} \ D and equal to vector v in all dimensions j 6 D: 

swap(u,v,D)j = j " J for j = 1,2, ...,s. (3) 

Let matrix [Mi,j] nxn be constructed as 

Mi,j = wiswapiA 1 ,A>,D)) . (4) 

It is clear that the solution of the corresponding 2-AP is exactly the required permutation p. Indeed, as- 
sume there exists some permutation p' such that w(pd(A, p')) < w(pd(A, p)). Observe that pn (A, p) = 
{swap(A\ A p{ ^ , D) : i € {1, 2, . . . , n}}. Then we have 

n n 

^2w{swap(A\A p '^,D)) <^w{swap{A\ A p ^ , D)) . 

i=l i=l 

Since w{swap{A l , A p ^ l \ D)) — M i p ^, the sum J27=i w(swap(A l , A p ^ , D)) is already minimized to 
the optimum and no p 1 can exist. 



Local Search Heuristics for the Multidimensional Assignment Problem 



4 



The neighborhood of a dimensionwise heuristic is as follows: 

N D y(A) = [pd{A, p) : DeP and p is a permutation} , (5) 
where T> includes all dimension subsets acceptable by a certain heuristic. Observe that 

p D (A,p) =p IJ {A,p- 1 ) , (6) 

where p^ 1 (p) = p{p~ r ) = 1« an d D = {1, 2, . . . , s} \ D, and, hence, 

{po(A,p): p is a permutation} = {pjj(A, p) : p is a permutation} (7) 

for any D. From (O and the obvious fact that P0(A, p) = P{i,2,...,s}(A, p) — A for any p we introduce the 
following restrictions for V: 

DeV=>~D£V and 0, {1, 2, . . . , s} £ V . (8) 

With these restrictions, one can see that for any pair of distinct sets D±, D2 E T> the equation pn 1 (A, pi) = 
Pd 2 (A P2) holds if and only if p\ = p^ = l n . Hence, the size of the neighborhood Nov (A) is 

\N m (A)\ = \V\-(nl-l) + l. (9) 

In |[3] it is decided that the number of iterations should not be exponential with regards to neither n 
nor s while the size of the maximum V is \V\ = 2 S_1 — 1. Therefore two heuristics, LSI and LS2, are 
evaluated in (5). LSI includes only singleton values of D, i.e., T> = {D : \D\ = 1}; LS2 includes 
only doubleton values of D, i.e., V = {D : \D\ = 2}. It is surprising but according to both [5| and 
our computational experience, the heuristic LS2 produces worse solutions than LS 1 though it obviously 
has larger neighborhood and larger running times. We improve the heuristic by allowing \D\ < 2, i.e., 
V = {D : \D\ < 2}. This does not change the theoretical time complexity of the algorithm but improves 
its performance. The heuristic LSI is called 1 DV in our paper; LS2 with \D\ < 2 is called 2DV. We also 
assume (see Section [TJ that the value of s is a small fixed constant and, thus, introduce a heuristic sDV 
which enumerates all feasible (recall dHJ) D C {1,2,..., s). 

The order in which the heuristics take the values D e Pin our implementations is as follows. For 1 DV 
it is {1}, {2}, . . . , {s}. 2DV begins as 1 DV and then takes all pairs of dimensions: {1,2}, {1, 3}, . . . , {1, s}, 
{2, 3}, . . . , {s — 1, s}. Note that because of ((H) it enumerates no pairs of vectors for s — 3, and for s = 4 it 
only takes the following pairs: {2, 3}, {2, 4} and {3, 4}. sDV takes first all sets D of size 1, then all sets D 
of size 2 and so on up to | D = [s/2\ . If s is even then we should take only half of the sets D of size s/2 
(recall (|7|i); for this purpose we take all the subsets of D C {2, 3, . . . , s}, \D\ = s/2 in the similar order as 
before. 

It is obvious that N\dv(A) C N2dv(A) C 7V s dv(^4) for any s however for s = 3 all the neighborhoods 
are equal and for s = 4 2DV and sDV also coincide. 

According to ^ and (O, the neighborhood size of 1 DV is 



of 2DV is 

\Nwv(A)\ = 

and of sDV is 



\N im (A)\ = s-(n\-l) + l, 

(2 s - 1 - 1) ■ (n! - 1) + 1 if s G {3, 4} 
((2) +s) .(n!-l) + l ifs>5 



|7V sDV (A)| = (2 s - 1 -l)-(n!-l) + l. 

The time complexity of every run of DV is 0(|X>| • n 3 ) as every 2-AP takes 0(n 3 ) and, hence, the time 
complexity of 1 DV is 0(s ■ n 3 ), of 2DV is 0(s 2 ■ n 3 ) and of MDV is 0(2 S - 1 ■ n 3 ). 
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2.2 A;-opt 

The fc-opt heuristic for 3-AP for k = 2 and k = 3 was first introduced by Balas and Saltzman [4] as a 
pairwise and triple interchange heuristic. 2-opt as well as its variations were also discussed in Q] [10] [27] 
[28][3T][35| and some other papers. We generalize the heuristic for arbitrary values of k and s. 

The heuristic proceeds as follows. For every subset of k vectors taken in the assignment A it removes all 
these vectors from A and inserts some new k vectors such that the assignment feasibility is preserved and 
its weight is minimized. Another definition is as follows: for every set of distinct vectors e 1 , e 2 , . . . , e k G A 
let X'j = {ej, e 2 , . . . , ej?} for j = 1, 2, . . . , k. Let A 1 = {e' 1 , e' 2 , . . . , e' k } be the solution of this s-AP of 
size k. Replace the vectors e , e 2 , . . . , e k in the initial assignment A with e , e' 2 , . . . , e' k . 

The time complexity of fc-opt is obviously O ((?) ■ /c! s_1 ); for <C n it can be replaced with 0(n k ■ 
fc!^ 1 ). It is a natural question if one can use some faster solver on every iteration. Indeed, according to 
SectionQ]it is possible to solve s-AP of size k in 0(kl s ~ 2 ■ k 3 ). However, it is easy to see that fcP -1 < 
k\ s ~ 2 ■ k 3 for every k up to 5, i.e., it is better to use the exhaustive search for any reasonable k. One can 
doubt that the exact algorithm actually takes k\ s ~ 2 ■ k 3 operations but even for the lower bound Sl(fc! s_2 • k 2 ) 
the inequality fc! s_1 < k\ s ~ 2 ■ k 2 holds for any k < 3, i.e., for all the values of k we actually consider. 

Now let us find the neighborhood of the heuristic. For some set X and a subset / C X let a permutation 
p of elements in X be an I -permutation if p(i) — i for every i 6 X \ I, i.e., if p does not move any 
elements except elements from /. Let E = {e 1 , e 2 , . . . ,e k } C A be a set of k distinct vectors in A. 
For j = 2, 3, . . . , s let pj be an Ej -permutation, where Ej = {ej, e 2 , . . . , e k }. Then a set W(A, E) of 
all assignments which can be obtained from A by swapping coordinates of vectors E can be described as 
follows: 

W(A, E) = {p(A, 1„, p 2 ,p 3 ,---, p s ) ■ Pj is an E^permutation for j = 2, 3, . . . , s} . 

Recall that 1„ is the identity permutation of size n and p(A, pi, p2, . . . , p s ) is defined by ([T). 
The neighborhood N^ pt(A) is defined as follows: 

AW(4>= (J WXA-E). (10) 

EcA,\E\=k 

Let Y", Z C A such that |Y| = \Z\ = k. Observe that W(A, Y) n Z) is nonempty and apart from 

the initial assignment A this intersection may contain assignments which are modified only in the common 
vectors Y PI Z. To calculate the size of the neighborhood of fc-opt let us introduce W'(A, E) as a set of all 
assignments in W(A, E) such that every vector in E is modified in at least one dimension, where E C A 
is the set of k selected vectors in the assignment A: 

W'(A, E) = {A' e W(A, E): \An A'\ = n - k} . 

Then the neighborhood Nk- op t(A) of fc-opt is 

N k . opt (A)= [j W'{A,E) (11) 

EdA,\E\<k 

and since W(A, Y) n W(A, Z) = if Y ^ Z we have 

iaw(^)i = E ^'(a^i = E , d2) 
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where N l = \W(A, E) \ for any E with \E\ = i. Observe that 

W'(A,E) = W(A,E)\ |J W'(A, E') 

E'CE 

and \W(A, E)\ = fc! 5 " 1 for \E\ = k and, hence, 

N k = ki 3 - 1 -J2 ( k -) Ni ■ 

i=0 

It is obvious that TV = 1 since one can obtain exactly one assignment (the given one) by changing no 
vectors. From this and CS) we have N 1 = 0, N 2 = 2 s " 1 - 1 and TV 3 = 6 S_1 - 3 • 2 s " 1 + 2. From this 
and ( flZb follows 



|iV 2 . opt (A)| = 1+ lUy^-l), (14) 
\N 3 . opt (A)\ =l+(") (2 s - 1 1) + (") (6 s " 1 - 3 ■ 2 s - 1 + 2) . (15) 



In our implementation, we skip an iteration if the corresponding set of vectors E either consists of the 
vectors of the minimal weight (w(e) — min ee x w(e) for every e € E) or all these vectors have remained 
unchanged during the previous run of fc-opt. 

It is assumed in the literature |4] [31] [35l that fc-opt for k > 2 is too slow to be applied in practice. 
However, the neighborhood Nk- op t do not only includes the neighborhood N( k _ 1 y opl but also grows expo- 
nentially with the growth of k and, thus, becomes very powerful. We decided to include 2-opt and 3-opt in 
our research. Greater values of k are not considered in this paper because of nonpractical time complexity 
(observe that the time complexity of 4-opt is 0(n A ■ 24 s-1 )) and even 3-opt with all the improvements de- 
scribed above still takes a lot of time to proceed. However, 3-opt is more robust when used in a combination 
with some other heuristic (see Section |2~4l >. 

It is worth noting that our extension of the pairwise (triple) interchange heuristic [4] is not typical. Many 
papers [1, 10, 27, 31, 35 1 consider another neighborhood: 

-^fc-opt* (A) = {pd{A, p) : D C {1, 2, . . . , s}, \D\ — 1 and p moves at most k elements} , 

where po is defined in ©. The size of such neighborhood is |7Vfc_ opt *(A)| = s ■ (?) • (fc! — 1) + 1 and 
the time complexity of one run of fc-opt* in the assumption k -C n is 0(s ■ n k ■ fc!), i.e., unlike fc-opt, it is 
not exponential with respect to the number of dimensions s which is considered to be important by many 
researchers. However, as it is stated in SectionQ] we assume that s is a small fixed constant and, thus, the 
time complexity of fc-opt is still reasonable. At the same time, observe that N^ op t* (A) C iVi-Dv(^) for 
any k < n, i.e., 1 DV performs as good as n-opt* with the time complexity of 3-opt*. Only in the case of 
k = 2 the heuristic 2-opt* is faster in theory however it is known Q that the expected time complexity of 
AP is significantly less than 0(n 3 ) and, thus, the running times of 2-opt* and 1 DV are similar while 1 DV is 
definitely more powerful. Because of this we do not consider 2-opt* in our comparison. 
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2.3 Variable Depth Interchange (v-opt) 

The Variable Depth Interchange (VDI) was first introduced by Balas and Saltzman for 3-AP as a heuristic 
based on the well known Lin-Kernighan heuristic for the traveling salesman problem |4|. We provide 
here a natural extension v-opt of the VDI heuristic for the s-dimensional case, s > 3, and then improve this 
extension. Our computational experiments show that the improved version of v-opt is superior to the natural 
extension of VDI with respect to solution quality at the cost of a reasonable increase in running time. In 
what follows, v-opt refers to the improved version of the heuristic unless otherwise specified. 

In [4], the heuristic is described quite briefly. Our contribution is not only in the extending, improving 
and analyzing it but also in a more detailed and, we believe, clearer explanation of it. We describe the 
heuristic in a different way to the description provided in [4|, however, both versions of our algorithm are 
equal to VDI in case of s = 3. This fact was also checked by reproduction of the computational evaluation 
results reported in |4|. 

Further we will use function U (u, v) which returns a set of swaps between vectors u and v. The 
difference between the two versions of v-opt is only in the U (u, v) definition. For the natural extension of 
VDI, let U (u, v) be a set of all the possible swaps (see (0) in at most one dimension between the vectors u 
and v, where the coordinates in at most one dimension are swapped: 

U(u,v) = {swap{u,v,D) : D C {1,2, ...,s} and \D\ < 1} . 

For the improved version of v-opt, let U(u,v) be a set of all the possible swaps in at most [s/2\ 
dimensions between the vectors v and w: 

U{u,v) = {swap(u,v,D) : D C {1, 2, . . . , s} and \D\ < s/2} . 

The constraint \D\ < s/2 guarantees that at least half of the coordinates of every swap are equal to the 
first vector coordinates. The computational experiments show that removing this constraint increases the 
running time and decreases the average solution quality. 

Let vector n(u, v) be the minimum weight swap between vectors u and v: 

n{u, v) — argmin w(e) . 

e£U(u,v) 

Let A be an initial assignment. 

1 . For every vector c G Ado the rest of the algorithm. 

2. Initialize the total gain G = 0, the best assignment A\, est = A, and a set of available vectors L = 
A\{c}. 

3. Find vector m E L such that w(fj,(c, to)) is minimized. Set v = p(c, m) and Vj — {cj, nij} \ {vj} 
for every 1 < j < s. Now v G U(c, m) is the minimum weight swap of c with some other vector m 
in the assignment, and v is the complementary vector. 

4. Set G — G + w(c) - w(v). If now G < 0, set A = A hest and go to the next iteration (Step[T])- 

5. Mark m as an unavailable for the further swaps: L = L \ {to}. Note that c is already marked 
unavailable: c ^ L. 

6. Replace to and c with v and v. Set c = v. 

1. If w(A) < w(Abest), save the new assignment as the best one: A\, est = A. 
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8. Repeat from Step[3]while the total gain is positive (see StepHJi and L ^ 0. 

The heuristic repeats until no improvement is found during a run. The time complexity of one run of 
v-opt is 0(?i 3 • 2 S ~ 1 ). The time complexity of the natural extension of VDI is 0(n 3 ■ s), and the computation 
experiments also show a significant difference between the running times of the improved and the natural 
extensions. However, the solution quality of the natural extension for s > 7 is quite poor, while for the 
smaller values of s it produces solutions similar to or even worse than sDV solutions at the cost of much 
larger running times. 

The neighborhood N v . opt (A) is not fixed and depends on the MAP instance and initial assignment A. 
The number of iterations (runs of Step [3} of the algorithm can vary from n to n 2 . Moreover, there is no 
guarantee that the algorithm selects a better assignment even if the corresponding swap is in U (c, m). Thus, 
we do not provide any results for the neighborhood of v-opt. 

2.4 Combined Neighborhood 

We have already presented two types of neighborhoods in this paper, let us say dimensionwise (Section l2~Tl i 
and vectorwise (Sections 12. 2| and |2~3"T l. The idea of the combined heuristic is to use the dimensionwise and 
the vectorwise neighborhoods togeather, combining them into so called Variable Neighborhood Search [38 1. 
The combined heuristic improves the assignment by moving it into the local optimum with respect to the 
dimensionwise neighborhood, then it improves it by moving it to the local minimum with respect to the 
vectorwise neighborhood. The procedure is repeated until the assignment occurs in the local minimum with 
respect to both the dimensionwise and the vectorwise neighborhoods. 

More formally, the combined heuristic DV op t consists of a dimensionwise heuristic DV (either 1 DV, 
2DV or sDV) and a vectorwise heuristic opt (either 2-opt, 3-opt or v-opt). DV op t proceeds as follows. 

1. Apply the dimensionwise heuristic A = DV(A). 



(a) Save the assignment weight x = w(A) and apply the vectorwise heuristic A — opt(A). 

(b) If w(A) = x stop the algorithm. 

(c) Save the assignment weight x = w(A) and apply the dimensionwise heuristic A = DV(A). 

(d) If w(A) = x stop the algorithm. 

Step Q] of the combined heuristic is the hardest one. Indeed, it is typical that it takes a lot of iterations 
to move a bad solution to a local minimum while for a good solution it takes just a few iterations. Hence, 
the first of the two heuristics should be the most efficient one, i.e., it should perform quickly and produce a 
good solution. In this case the dimensionwise heuristics are more efficient because, having approximately 
the same as vectorwise heuristics time complexity, they search much larger neighborhoods. The fact that 
the dimensionwise heuristics are more efficient than the vectorwise ones is also confirmed by experimental 
evaluation (see Section|4|. 

It is clear that the neighborhood of a combined heuristic is defined as follows: 



where Nov (A) and N opt (A) are neighborhoods of the corresponding dimensionwise and vectorwise heuris- 
tics respectively. To calculate the size of the neighborhood A^)v opl (A^) we need to find the size of the 
intersection of these neighborhoods. Observe that 



2. 



Repeat: 



N DV JA) = N DV (A)UN opt (A) , 



(16) 



Nd\(A) H Nk-o V t(A) = {pd(A, p) : D G D and p moves at most k elements} , 



(17) 
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where pr> (A, p) is defined by (|2}. This means that, if r k is the number of permutations on n elements which 
move at most k elements, the intersection ( fTTb has size 



\N m (A) n N k . opl (A)\ = \V\ ■ (rjk - 1) + 1 
The number r k can be calculated as 



E 



(18) 



(19) 



where di is the number of derangements on i elements, i.e., permutations on i elements such that none of 
the elements appear on their places; di — i\ ■ jy, n=0 (— l) m /m\ |[T9l . For k = 2, = 1 + (T) ; for k = 3, 
r 3 = 1 + (™) + 2(™). From ©, Q2), (Ell and ([TS]> we immediately have 



\Nuv k ^(A)\ =l + |D|.(n!-l) + 



E 

,i=2 



iV' 



^ I ■ (r fc - 1) 



(20) 



where N' 1 and r k are calculated according to (TT~3T > and (fT9b respectively. Substituting the value of A;, we 
have: 



= l + |2?|-(n!-l) + 1(2 



Inl- 



and 



(21) 



|^Dv 3 _ upl (^)| = l + l^-("!-l)+Q(2 s 



(6 s — - 3 • 2 s — + 2) - |X>| 



n \ „ / n 



(22) 



One can easily substitute |Z>| = s, \V\ = (*) and |D| = 2 s — - 1 to (ED or (f22]i to get the neighborhood 
sizes of 1 DV 2 , 2DV 2 , sDV 2 , 1 DV 3 , 2DV 3 and sDV 3 . We will only show the results for sDV 2 : 

-I 1 , , ..I / n \/os-l i , /os-1 > n 



\N sDV2 (A)\ = 1 + (2 s - - 1) ■ (n! - 1) + ^ 1 (2 s - - 1) - (2 s - - 1) y _ } 

= 1 + (2 s - 1 - 1) ■ (n! - 1) , (23) 

i.e., \N sDW2 (A)\ = \N sDV (A)\. Since N sDV (A) C N sDW2 (A) (see (fT6ll), we can conclude that N sD y 2 (A) = 
N s dv(A). Indeed, the neighborhood of 2-opt can be defined as follows: 

-^2-opt = {pd(A, p) : D C {2, 3, . . . , s} and p swaps at most two elements} , 

which is obviously a subset of iV S Dv(^4) (see Q). Hence, the combined heuristic sDV 2 is of no interest. 

For other combinations the intersection (T% is significantly smaller than both neighborhoods Nov (A) 
and Nfc_ p t (A) (recall that the neighborhood N v . opt has a variable structure). Indeed, |7Vdv(-4)| 3> \Nnv(A)n 
iV fe . p t (A) | because |D|-(n!-l) > \V\ -(r k -1) for k <C n. Similarly, \N 2 . opt (A)\ > \N DV (A)nN k . opt (A)\ 
because (™) (2 s " 1 - 1) » \V\ • (™) if \T>\ < 2 s " 1 , which is the case for 1 DV and 2DV if s is large enough. 
Finally, |AT 3 . opt (^)| » \N DV (A) n N k . opt (A)\ because Q)(2 S - - 1) + Q)(6 S - X - 3 • 2 s - + 2) » 
\V\ ■ [(") + 2(™)] , which is true even for \V\ = 2 s " 1 , i.e., for sDV. 

The time complexity of the combined heuristic is 0(n k ■ fc! s — + \T>\ ■ n 3 ) in case of opt = fc-opt and 
0(n 3 ■ (2 s — + \T>\)) if opt = v-opt. The particular formulas are provided in the following table: 
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2-opt 


3-opt 


v-opt 


1DV 


0(2 S ~ 1 -n 2 - 


- s ■ n 3 ) 0(6^ ■ n 3 ) 


0(2 S -n 3 ) 


2DV 


012 s - 1 -n 2 - 


- s 2 ■ n 3 ) 0(6^ ■ n 3 ) 


0(2 S -n 3 ) 


sDV 


(no interest) 


O^" 1 -n 3 ) 


0(2 S -n 3 ) 



Note that all the combinations with 3-opt and v-opt have equal time complexities; this is because the 
time complexities of 3-opt and v-opt are dominant. Our experiments show that the actual running times of 
3-opt and v-opt are really much higher then even the sDV running time. This means that the combinations 
of these heuristics with sDV are approximately as fast as the combinations of these heuristics with light di- 
mensionwise heuristics 1 DV and 2DV. Moreover, as it was noticed above in this section, the dimensionwise 
heuristic, being executed first, simplifies the job for the vectorwise heuristic and, hence, the increase of 
the dimensionwise heuristic power may decrease the running time of the whole combined heuristic. At the 
same time, the neighborhoods of the combinations with sDV are significantly larger than the neighborhoods 
of the combinations with 1 DV and 2DV. We can conclude that the 'light' heuristics 1 DV3, 2DV3, 1 DV V and 
2DV V are of no interest because the 'heavy' heuristics SDV3 and sDV v , having the same theoretical time 
complexity, are more powerful and, moreover, outperformed the 'light' heuristics in our experiments with 
respect to both solution quality and running time on average and in most of single experiments. 

2.5 Other algorithms 

Here we provide a list of some other MAP algorithms presented in the literature. 

• A host of local search procedures and construction heuristics which often have some approximation 
guarantee ([5 9 QT||2T][26][27) and some others) are proposed for special cases of MAP (usually with 
decomposable weights, see Section [3T2l > and exploit the specifics of these instances. However, as it 
was stated in Section[T] we consider only the general case of MAP, i.e., all the algorithms included in 
this paper do not rely on any special structure of the weight matrix. 

• A number of construction heuristics are intended to generate solutions for general case MAP [4 
[16] |23] 128). While some of them are fast and low quality, like Greedy, some, like Max-Regret, 
are significantly slower but produce much better solutions. A special class of construction heuris- 
tics, Greedy Randomized Adaptive Search Procedure (GRASP), was also investigated by many re- 
searchers fl] E7] |28] E2 . 

• Several metaheuristics, including a simulated annealing procedure [ 10 1 and a memetic algorithm [20 1, 
were proposed in the literature. Metaheuristics are sophisticated algorithms intended to search for the 
near optimal solutions in a reasonably large time. Proceeding for much longer than local search and 
being hard for theoretical analysis of the running time or the neighborhood, metaheuristics cannot be 
compared straightforwardly to local search procedures. 

• Some weak variations of 2-opt are considered in fJT] |27l [3T] [35) . While our heuristic 2-opt tries all 
possible recombinations of a pair of assignment vectors, i.e., 2 S_1 combinations, these variations 
only try the swaps in one dimension at a time, i.e., s combinations for every pair of vectors. We have 
already decided that these variations have no practical interest, for details see Section l2~2l 

3 Test Bed 

While the theoretical analysis can help in heuristic design, selection of the best approaches requires empir- 
ical evaluation lfT8l[34l . In this section we discuss the test bed and in Section|4]the experimental results are 
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reported and discussed. 

The question of selecting proper test bed is one of the most important questions in heuristic experi- 
mental evaluation [34|. While many researchers focused on instances with random independent weights 
([3][4][24][3T) and some others) and random instances with predefined solutions |[T0l[T5ll23l , several more 
sophisticated models are of greater practical interest 151 l9l ITTl [121 |26l . There is also a number of papers 
which consider real-world and pseudo real- world instances f6j[27l[30 | but the authors of this paper suppose 
that these instances do not well represent all the instance classes and building a proper benchmark with the 
real-world instances is a subject for another research. 

In this paper we group all the instance families into two classes: instances with independent weights 
(Section [3. It and instances with decomposable weights (Section [3. 21 >. Later we show that the heuristics 
perform differently on the instances of these classes and, thus, this devision helps us in correct experimental 
analysis of the local search algorithms. 



3.1 Instances With Independent Weights 

One of the most studied class of instances for MAP is Random Instance Family. In Random, the weight 
assigned to a vector is a random uniformly distributed integral value in the interval [a, 6—1]. Random 
instances were used in fl][3j|4][32) an( ^ some others. 

Since the instances are random and quite large, it is possible to estimate the average solution value for 
the Random Instance Family. The previous research in this area [24 1 show that if n tends to infinity than the 
problem solution approaches the bound an, i.e., the minimal possible assignment weight (observe that the 
minimal assignment includes n vectors of weight a). Moreover, an estimation of the mean optimal solution 
is provided in [14] but this estimation is not accurate enough for our experiments. In |[T8l we prove that it 
is very likely that every big enough Random instance has at least one arc-assignment, where x-assignment 
means an assignment of weight x. 

Let a be the number of assignments of weight an and let c = b — a. We would like to have an upper 
bound on the probability Pr(a = 0). Such an upper bound is given in the following theorem whose proof 
(see |[T8l ) is based on the Extended Jansen Inequality (see Theorem 8.1.2 of |f2l). 

Theorem 1. For any n such that n > 3 and 

(— 1 \ s 1 
^— J >c-2^t, (24) 

we have Pr(a = 0) < e ^ , where a — V -, — ; — -t^t — , , . 

v ' — \- n '( n ~ l) - "(n— k+l)\ 

The lower bounds of Pr(a > 0) for different values of s and n and for 6 — a — 100, are reported below. 



s = 4 



Pr(a > 0) 



15 0.575 

20 0.823 

25 0.943 

30 0.986 

35 0.997 

40 1.000 



Pr(a > 0) 



10 0.991 

11 0.998 

12 1.000 



s = 6 



s = 7 



n Pr(a > 0) 



n Pr(a > 0) 



8 1.000 



7 1.000 
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One can see that a 4-AP Random instance has an (an)-assignment with the probability which is very 
close to 1 if n > 40; a 5-AP instance has an (an)-assignment with probability very close to 1 for n > 12, 
etc.; so, the optimal solutions for all the Random instances used in our experiments (see Section|4]l are very 
likely to be of weight an. For s — 3 Theorem Q] does not provide a good upper bound, but we are able to 
use the results from Table II in [4| instead. Balas and Saltzman report that in their experiments the average 
optimal solution of 3-AP for Random instances reduces very quickly and has a small value even for n = 26. 
Since the smallest Random instance we use in our experiments has size n — 150, we assume that all 3-AP 
Random instances considered in our experiment are very likely to have an an-assignment. 

Useful results can also be obtained from (1 1) in 1 14| which is an upper bound for the average optimal 
solution. Grundel, Oliveira and Pardalos [ 14 1 consider the same instance family except the weights of the 
vectors are real numbers uniformly distributed in the interval [a, b}. However the results from |[T4l can be 
extended to our discrete case. Let w'(e) be a real weight of the vector e in a continuous instance. Consider 
a discrete instance with w(e) = [w'(e)\ (if w'(e) — b, set w(e) =6 — 1). Note that the weight w(e) is 
a uniformly distributed integer in the interval [a, b — 1]. The optimal assignment weight of this instance is 
not larger than the optimal assignment weight of the continuous instance and, thus, the upper bound for the 
average optimal solution for the discrete case is correct. 

In fact, the upper bound z* (see [14]) for the average optimal solution is not accurate enough. For 
example, z* w an + 6.9 for s — 3, n — 100 and b — a = 100, and z* w an + 3.6 for s = 3, n = 200 
and b — a = 100, so it cannot be used for s = 3 in our experiments. The upper bound z* gives a better 
approximation for larger values of s, e.g., z* w an + 1.0 for s = 4, n = 40 and b — a = 100, however, 
Theorem[T]provides stronger results (Pr(a > 0) w 1.000 for this case). 

Another class of instances with almost independent weights is GP Instance Family which contains 
pseudo-random instances with predefined optimal solutions. GP instances are generated by an algorithm 
produced by Grundel and Pardalos 03J. The generator is naturally designed for s-AP for arbitrary large 
values of s and n. However, it is relatively slow and, thus, it was impossible to generate large GP instances. 
Nevertheless, this is what we need since finally we have both small (GP) and large (Random) instances with 
independent weights with known optimal solutions. 

3.2 Instances With Decomposable Weights 

In many cases it is not easy to define a weight for an s-tuple of objects but it is possible to define a relation 
between every pair of objects from different sets. In this case one should use decomposable weights [37] 
(or decomposable costs), i.e., the weight of a vector e should be defined as follows: 

^(e)=/(^; 2 e2 ,^ 3 e 3,---,C-;: es ) . (25) 

where d l J is a distance matrix between the sets Xi and Xj and / is some function. 

The most natural instance family with decomposable weights is Clique, which defines the function / as 
the sum of all arguments: 

n— 1 n 

Me) = EE ■ (26) 

i=l j=i+l 

The Clique instance family was investigated in (5J [TT] |T2] and some others. It was proven [11 1 that MAP 
restricted to Clique instances remains NP-hard. 

A special case of Clique is Geometric Instance Family. In Geometric, the sets X\, X2, ■ ■ ■ , X s corre- 
spond to sets of points in Euclidean space, and the distance between two points u € Xi and v £ Xj is 
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defined as Euclidean distance; we consider the two dimensional Euclidean space: 



d s (u, v) = J (u x - v x ) 2 + (u y - v y ) 2 



It is proven [36] that the Geometric instances are NP-hard to solve for s — 3 and, thus, Geometric is NP-hard 
for every s > 3. 

In this paper, we propose a new special case of the decomposable weights, SquareRoot. It is a modifi- 
cation of the Clique instance family. Assume we have s radars and n planes and each radar observes all the 
planes. The problem is to assign signals which come from different radars to each other. It is quite natural to 
define a distance function between each pair of signals from different radars, and for a set of signals which 
correspond to one plane the sum of the distances should be small so d26l i is a good choice. However, it is 
not actually correct to minimize the total distance between the assigning signals but one should also ensure 
that none of these distances is too large. Same requirements appear in a number of other applications. We 
propose a weight function which can leads to both small total distance between the assigned signals and 
small dispersion of the distances: 



Similar approach is used in 11261 though they do not use square root, i.e., a vector weight is just a sum of 
squares of the edge weights in a clique. In addition, the edge weights in [26 1 are calculated as distances 
between some nodes in a Euclidean space. 

Another special case of the decomposable weights, Product, is studied in [9|. Burkard et al. consider 
3-AP and define the weight w(e) as w(e) = a* ■ a 2 2 ■ a 3 3 , where a 1 , a 2 and a 3 are random vectors of 
positive numbers. It is easy to show that the Product weight function can be represented in the form (1251 . It 
is proven that the minimization problem for the Product instances is NP-hard in case s = 3 and, thus, it is 
NP-hard for every s > 3. 

4 Computational Experimentation 

In this section, the results of empirical evaluation are reported and discussed. The experiments were con- 
ducted for the following instances (for instance family definitions see Section[3]i: 

• Random instances where each weight was randomly chosen in {1, 2, . . . , 100}, i.e., a = 1 and b = 
101. According to Subsection 13. II the optimal solutions of all the considered Random instances are 
very likely to be an = n. 

• GP instances with predefined optimal solutions (see Section l3~Tl >. 

• Clique and SquareRoot instances, where the weight of each edge in the graph was randomly selected 
from {1,2,..., 100}. Instead of the optimal solution value we use the best known solution value. 

• Geometric instances, where both coordinates of every point were randomly selected from {1, 2, . . . , 100}. 
The distances between the points are calculated precisely while the weight of a vector is rounded to 
the nearest integer. Instead of the optimal solution value we use the best known solution value. 

• Product instances, where every value a\ was randomly selected from {1,2,..., 10}. Instead of the 
optimal solution value we use the best known solution value. 




n-l 



n 



(27) 
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An instance name consists of three parts: the number s of dimensions, the type of the instance ('gp' 
for GP, 'r' for Random, 'c' for Clique, 'g' for Geometric, 'p' for Product and 'sr' for SquareRoot), and 
the size n of the instance. For example, 5r4 means a five dimensional Random instance of size 40. For 
every combination of instance size and type we generated 10 instances, using the number seed = s + n + i 
as a seed of the random number sequences, where i is an index of the instance of this type and size, 
i G {1,2,..., 10}. Thereby, every experiment is conducted for 10 different instances of some fixed type 
and size, i.e., every number reported in the tables below is average for 10 runs for 10 different instances. 

The sizes of all but GP instances are selected such that every algorithm could process them all in 
approximately the same time. The GP instances are included in order to examine the behavior of the 
heuristics on smaller instances (recall that GP is the only instance set for which we know the exact solutions 
for small instances). 

All the heuristics are implemented in Visual C++. The evaluation platform is based on AMD Athlon 64 
X2 3.0 GHz processor. 

Further, the results of the experiments of three different types are provided and discussed: 

• In Subsection 14. 11 the local search heuristics are applied to the assignments generated by some con- 
struction heuristic. These experiments allow us to exclude several local searches from the rest of 
the experiments, however, the comparison of the results is complicated because of the significant 
difference in both the solution quality and the running time. 

• In Subsection |4.21 two simple metaheuristics are used to equate the running times of different heuris- 
tics. This is done by varying of number of iterations of the metaheuristics. 

• In Subsection l4.3l the results of all the discussed approaches are gathered in two tables to find the most 
successful solvers for the instance with independent and decomposable weights for every particular 
running time. 

4.1 Pure Local Search Experiments 

First, we run every local search heuristic for every instance exactly once. The local search is applied to 
solutions generated with one of the following construction heuristics: 

1. Trivial, which was first mentioned in [4] as Diagonal. Trivial construction heuristic simply assigns 
Aj = i for every i = 1,2, ... ,n and j = 1, 2, . . . , s. 

2. Greedy heuristic was discussed in many papers, see, e.g. It4l [9l IT61 fTTl n~8l [23ll . It was proven ifTBI 
that in the worst case Greedy produces the unique worst solution; however, it was shown [ 17 1 that in 
some cases Greedy may be a good selection as a fast and simple heuristic. 

3. Max-Regret was discussed in a number of papers, see, e.g., |0][9l[l6l|23][35]. As for Greedy, it is 
proven [16] that in the worst case Max-Regret produces the unique worst solution however many 
researchers 0[23) noted that Max-Regret is quite powerful in practice. 

4. ROM was first introduced in IfTBI as a heuristic of a large domination number. On every iteration, 
the heuristic calculates the total weight for every set of vectors with the fixed first two coordinates: 

= SeeXei=i e 2 =j w ( e )- Then it solves a 2- AP for the weight matrix M and reorders the second 
dimension of the assignment according to this solution and the first dimension of the assignment. 
The procedure is repeated recursively for the subproblem where the first dimension is excluded. For 
details see lfT6ll23l . 
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We will begin our discussion from the experiments started from trivial assignments. The results reported 
in Tables|2]and[3]are averages for 10 experiments since every row of these tables corresponds to 10 instances 
of some fixed type and size but of different seed values (see above). The tables are split into two parts; the 
first part contains only the instances with independent weights (GP and Random) while the second part 
contains only the instances with decomposable weights (Clique, Geometric, Product and SquareRoot). The 
average values for different instance families and numbers of dimensions are provided at the bottom of each 
part of each table. The tables are also split vertically according to the classes of heuristics. The winner in 
every row and every class of heuristics is underlined. 

The value of the solution error is calculated as (w(A)/w(A\, est ) — l) • 100%, where A is the obtained 
assignment and ^4best is the optimal assignment (or the best known one, see above). 

In the group of the vectorwise heuristics the most powerful one is definitely 3-opt. v-opt outperforms it 
only in a few experiments, mostly three dimensional ones (recall that the neighborhood of fc-opt increases 
exponentially with the increase of the number of dimensions s). As it was expected, 2-opt never outperforms 
3-opt since iV2- op t C A^- op t (see Section l2?2l i. The tendencies for the independent weight instances and for 
the decomposable weight instances are similar; the only difference which is worth to note is that all but 
v-opt heuristics of this group solve the Product instances very well. Note that the dispersion of the weights 
in Product instances is really high and, thus, v-opt, which minimizes the weight of only one vector in every 
pair of vectors while the weight of the complementary vector may increase arbitrary, cannot be efficient for 
them. 

As one can expect, sDV is more successful than 2DV and 2DV is more successful than 1 DV with respect 
to the solution quality (obviously, all the heuristics of this group perform equally for 3-AP and 2DV and 
sDV are also equal for 4-AP, see Section [27Tb . However, for the instances with decomposable weights all 
the dimensionwise heuristics perform very similarly and even for the large s, sDV is not significantly more 
powerful than 1 DV or 2DV which means that in case of decomposable instances the most efficient iterations 
are when \D\ = 1. We can assume that if c is the number of edges connecting the fixed and unfixed parts of 
the clique, then an iteration of a dimensionwise heuristic is rather efficient when c is small. Observe that, 
e.g., for Clique the diversity of values in the weight matrix [Mi,j] nxn (see (0I) decreases with the increase 
of the number c and, hence, the space for optimization on every iteration is decreasing. Observe also that in 
the case c = 1 the iteration leads to the optimal match between the fixed and unfixed parts of the assignment 
vectors. 

All the combined heuristics show improvements in the solution quality over each of their components, 
i.e., over both corresponding vectorswise and dimensionwise local searches. In particular, 1 DV2 outper- 
forms both 2-opt and 1DV, 2DV 2 outperforms both 2-opt and 2DV, sDV 3 outperforms both 3-opt and sDV 
and sDV v outperforms both v-opt and sDV. Moreover, SDV3 is significantly faster than 3-opt and sDV v is 
significantly faster than v-opt. Hence, we will not discuss the single heuristics 3-opt and v-opt in the rest of 
the paper. The heuristics 1 DV2 and 2DV2, obviously, perform equally for 3-AP instances. 

While for the instances with independent weights the combination of the dimensionwise heuristics with 
the vectorwise ones significantly improves the solution quality, it is not the case for the instances with 
decomposable weights (observe that 1 DV performs almost as well as the most powerful heuristic SDV3) 
which shows the importance of the instances division. We conclude that the vectorwise neighborhoods are 
not efficient for the instances with decomposable weights. 

Next we conducted the experiments starting from the other construction heuristics. But first we com- 
pared the construction heuristics themselves, see Table Q] It is not surprising that Trivial produces the worst 
solutions. However, one can see that Trivial outperforms Greedy and Max-Regret for every Product instance. 
The reason is in the extremely high dispersion of the weights in Product. Both Greedy and Max-Regret con- 
struct the assignments by adding new vectors to it. The decision which vector should be added does not 
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depend (or does not depend enough in case of Max-Regret) on the rest of the vectors and, thus, at the end of 
the procedure only the vectors with huge weights are available. For other instance families, Greedy, Max- 
Regret and ROM perform similarly though the running time of the heuristics is very different. Max-Regret 
is definitely the slowest construction heuristic; Greedy is very fast for the Random instances (this is because 
of the large number of vectors of the weight a and the implementation features, see fl23ll for details) and 
relatively slow for the rest of the instances; ROM's running time almost does not depend on the instance 
and is constantly moderate. 

Starting from Greedy (Table |4| significantly improves the solution quality. This mostly influenced the 
weakest heuristics, e.g., 2-opt average error decreased in our experiments from 59% and 20% to 15% and 
6% for independent and decomposable weights respectively, though, e.g., the most powerful heuristic SDV3 
error also noticeably decreased (from 2.8% and 5.8% to 2.0% and 2.5%). As regards the running time, 
Greedy is slower than most of the local search heuristics and, thus, the running times of all but SDV3 and 
sDV v heuristics are very similar. The best of the rest of the heuristics in this experiment is sDV though 1 DV2 
and 2DV2 perform similarly. 

Starting from Max-Regret improves the solution quality even more but at the cost of very large running 
times. In this case the difference in the running time of the local search heuristics almost disappears and 
SDV3, the best one, reaches the average error values 1.3% and 2.2% for independent and decomposable 
weights respectively. Starting from ROM improves the quality only for the worst heuristics. This is probably 
because all the best heuristics contain sDV which does a good vectorwise optimization (recall that ROM 
exploits a similar to the dimensionwise neighborhood idea). At the same time, starting from ROM increases 
the running time of the heuristics significantly; the results for both Max-Regret and ROM are excluded from 
the paper; one can find them on the web [22]. 

It is clear that the construction heuristics are quite slow comparing to the local search and we should 
answer the following question: is it worth to spend so much time on the initial solution construction or there 
is some way to apply local search several times in order to improve the assignments iteratively? It is known 
that the algorithms which apply local search several times are called metaheuristics. There is a number of 
different metaheuristic approaches such as tabu search or memetic algorithms, but this is not the subject of 
this paper. In what follows, we are going to use two simple metaheuristics, Chain and Multichain. 

4.2 Experiments With Metaheuristics 

It is obvious that there is no sense in applying a local search procedure to one solution several times be- 
cause the local search moves the solution to a local minimum with respect to its neighborhood, i.e., the 
second exploration of this neighborhood is useless. In order to apply the local search several times, one 
should perturb the solution obtained on the previous iteration. This idea immediately brings us to the first 
metaheuristic, let us say Chain: 

1. Initialize an assignment A; 

2. Set A b est = A; 

3. Repeat: 

(a) Apply local search A = LS(A); 

(b) If w(A) < w(Aest) set A 

best ^-1 

(c) Perturb the assignment A = Perturb(A). 

In this algorithm we use two subroutines, LS(A) and Perturb(A). The first one is some local search 
procedure and the second one is an algorithm which removes the given assignment from the local minimum 
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by a random perturbation of it. The perturbation should be strong enough such that the assignment will 
not come back to the previous position on the next iteration every time though it should not be too strong 
such that the results of the previous search would be totally destroyed. Our perturbation procedure selects 
p = [n/25] + 1 vectors in the assignment and perturbs them randomly. In other words, Perturb(A) is just 
a random move of the p-opt heuristic. The parameters of the procedure are obtained empirically. 

One can doubt if Chain is good enough for large running times and, thus, we introduce a little bit more 
sophisticated metaheuristic, Multichain. Unlike Chain, Multichain maintains several assignments on every 
iteration: 

1. Initialize assignment Abest; 

2. Set P = and repeat the following c(c + 1) /2 times: 

P = PU {LS(Perturb(A best ))} 

(recall that Perturb(A) produces a different assignment every time); 

3. Repeat: 

(a) Save the best c assignments from P into C\, C-2, . . . , C c such that w(Ci) < u>(C;+i); 

(b) If io(Ci) < w(C hesl ) set A best = Ci. 

(c) Set P = and for every i — 1, 2, . . . , c repeat the following c — i + 1 times: P = P U 
{LSiPerturbid))}. 

The parameter c is responsible for the power of Multichain; we use c = 5 and, thus, the algorithm 
performs c(c + l)/2 = 15 local searches on every iteration. 

The results of the experiments with Chain running for 5 and 10 seconds are provided in Tables [5] and [6] 
respectively. The experiments are repeated for three construction heuristics, Trivial, Greedy and ROM. It 
was not possible to include Max-Regret in the comparison because it takes much more than 10 seconds for 
some of the instances. 

The diversity in solution quality of the heuristics decreased with the usage of a metaheuristic. This is 
because the fast heuristics are able to repeat more times than the slow ones. Note that SDV3, which is the 
most powerful single heuristic, is now outperformed by other heuristics. The most successful heuristics for 
the instances with independent and decomposable weights are sDV v and 1 DV respectfully, though 1 DV2 and 
2DV2 are slightly more successful than sDV v for the GP instances. This result also holds for Multichain, see 
Tables|7]and[8] The success of 1 DV confirms again that a dimensionwise heuristic is most successful when 
\D\ = 1 if the weights are decomposable and that it is more efficient to repeat these iterations many times 
rather than try \D\ > 1. For the explanation of this phenomenon see Section |4~T1 The success of 1 DV2 and 
2DV2 for GP means existence of a certain structure in the weight matrices of these instances. 

One can see that the initialization of the assignment is not crucial for the final solution quality. However, 
using Greedy instead of Trivial clearly improves the solutions for almost every instance and local search 
heuristic. In contrast to Greedy, using of ROM usually does not improve the solution quality. It only 
influences 2-opt which is the only pure vectorwise local search in the comparison (recall that ROM has a 
dimensionwise structure and, thus, it is good in combination with vectorwise heuristics). 

The Multichain metaheuristic, given the same time, obtains better results than Chain. However, Multi- 
chain fails for some combinations of slow local search and hard instance because it is not able to complete 
even the first iteration in the given time. Chain, having much easier iterations, do not have this disadvantage. 

Giving more time to a metaheuristic also improves the solution quality. Therefore, one is able to obtain 
high quality solutions using metaheuristic s with large running times. 
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4.3 Solvers Comparison 

To compare all the heuristics and metaheuristics discussed in this paper we produced Tablesl9land[T0l These 
tables indicate which heuristics should be chosen to solve particular instances in the given time limitations. 
Several best heuristics are selected for every combination of the instance and the given time. A heuristic is 
included in the table if it was able to solve the problem in the given time, and if its solution quality is not 
worse than 1.1 • w(Ah es t) and its running time is not larger than 1.1 • tbest, where Ah es t is the best assignment 
produced by the considered heuristics and ib es t is the time spent to produce A\, est . 
The following information is provided for every solver in Tablesl9land[T0l 

• Metaheuristic type (C for Chain, MC for Multichain or empty if the experiment is single). 

• Local search procedure (2-opt, 1 DV, 2DV, sDV, 1 DV 2 , 2DV 2 , sDV 3 sDV v or empty if no local search 
was applied to the initial solution). 

• Construction heuristic the experiment was started with (Gr, M-R or empty if the assignment was 
initialized by Trivial). 

• The solution error in percent. 

The following solvers were included in this experiment: 

• Construction heuristics Greedy, Max-Regret and ROM. 

• Single heuristics 2-opt, 1 DV, 2DV, sDV, 1 DV 2 , 2DV 2 , sDV 3 and sDV v started from either Trivial, Greedy, 
Max-Regret or ROM. 

• Chain and Multichain metaheuristics for either 2-opt, 1 DV, 2DV, sDV, 1 DV 2 , 2DV 2 , sDV 3 or sDV v and 
started from either Trivial, Greedy, Max-Regret or ROM. The metaheuristics proceeded until the given 
time limitations. 

Note that for certain instances we exclude duplicating solvers (recall that all the dimensionwise heuris- 
tics perform equally for 3-AP as well as 2DV and sDV perform equally for 4-AP, see Section [27Tb . The 
common rule is that we leave sDV rather than 2DV and 2DV rather than 1 DV. For example, if the list of suc- 
cessful solvers for some 3-AP instance contains C 1DV Gr, C 2DV Gr and C sDV Gr, then only C sDV Gr 
will be included in the table. This is also applicable to the combined heuristics, e.g, having IDV2 R and 
2DV2 R for a 3-AP instance, we include only 2DV2 R in the final results. 

The last row in every table indicates the heuristics which are the most successful on average, i.e., the 
heuristics which can solve all the instances with the best average results. 

Single construction heuristics are not presented in the tables; single local search procedures appear only 
for the small allowed times when all other heuristics take more time to run; the most of the best solvers 
are the metaheuristics. Multichain seems to be more suitable than Chain for large running times; however, 
Multichain does not appear for the instances with small n. This is probably because the power of the 
perturbation degree increases with the decrease of the instance size (note that perturb(A) perturbs at least 
two vectors in spite of n). 

The most successful heuristics for the assignment initialization are Trivial and Greedy; Trivial is useful 
rather for small running times. Max-Regret and ROM appear only a few times in the tables. 

The success of a local search depends on the instance type. The most successful local search heuristic 
for the instance with independent weights is definitely sDV v . The sDV heuristic also appears several times 
in Table|9] especially for the small running times. For the instances with decomposable weights, the most 
successful are the dimensionwise heuristics and, in particular, 1 DV. 
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5 Conclusions 

Several neighborhoods are generalized and discussed in this paper. An efficient approach of joining different 
neighborhoods is successfully applied; the yielded heuristics showed that they combine the strengths of 
their components. The experimental evaluation for a set of instances of different types show that there are 
several superior heuristic approaches suitable for different kinds of instances and running times. Two kinds 
of instances are selected: instances with independent weights and instances with decomposable weights. 
The first ones are better solvable by a combined heuristic sDV v ; the second ones are better solvable by 1 DV. 
In both cases, it is good to initialize the assignment with the Greedy construction heuristic if there is enough 
time; otherwise one should use a trivial assignment as the initial one. The results can also be significantly 
improved by applying metaheuristic approaches for as log as possible. 

Thereby, it is shown in the paper that metaheuristics applied to the fast heuristics dominate slow heuris- 
tics and, thus, further research of some more sophisticated metaheuristics such as memetic algorithms is of 
interest. 
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Tab. 1 : Construction heuristics comparison. 

Solution error, % Running times, ms 

Inst. Best Trivial Greedy Max-Regret ROM Trivial Greedy Max-Regret ROM 
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Tab. 2: Local search heuristics started from Trivial. 
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11.9 


17.4 


12.7 


13.9 


13.6 


12.7 


13.9 


11.5 


12.6 


7cql2 


6663.7 


11.9 


5.3 


10.4 


8.0 


7.0 


5.9 


7.1 


6.9 


5.7 


5.8 


7gl2 


3267.2 


0.0 


0.0 


9.9 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7pl2 558611.7 


0.0 


0.0 


123.6 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7srl2 


1795.7 


12.1 


7.6 


11.0 


8.5 


10.1 


7.1 


8.3 


10.1 


5.9 


7.0 


8cq8 


7004.9 


6.4 


3.0 


8.5 


6.4 


4.4 


4.8 


5.3 


4.1 


2.2 


4.7 


8g8 


3679.5 


0.0 


0.0 


9.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8p8 2233760.0 


0.0 


OO 


143.8 


0.1 


0.0 


0.0 


0.0 


0.0 


OO 


0.0 


8sr8 


1622.1 


6.6 


2.6 


7.4 


5.7 


5.0 


4/7 


4.9 


4.4 


3.5 


4.7 


All avg. 




21.8 


10.7 


32.2 


7.8 


7.4 


73 


7.5 


7.4 


6Jj 


6.9 


Clique avg. 


40.7 


20.0 


18.2 


14.4 


13.6 


13.7 


14.0 


13.5 


12.5 


12.8 


Geom. avg 




0.0 


0.0 


10.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Product av 


g- 


0.0 


0.0 


80.6 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


SR avg. 




46.5 


22.6 


19.9 


16.3 


16.1 


15.4 


16.0 


16.0 


13.9 


14.7 


3-AP avg. 




67.3 


28.5 


17.9 


10.5 


10.5 


10.5 


10.5 


10.5 


10.4 


10.1 


4-AP avg. 




27.3 


15.5 


30.7 


12.7 


12.0 


12.0 


12.6 


12.0 


11.2 


11.0 


5-AP avg. 




17.3 


9.4 


26.9 


9.7 


9.3 


9.3 


9.5 


9.3 


8.3 


8.6 


6-AP avg. 




9.6 


6.0 


36.8 


6.2 


6.1 


6.3 


6.0 


6.1 


5.4 


6.0 


7-AP avg. 




6.0 


3.2 


38.7 


4.2 


4.3 


3.2 


3.8 


4.3 


2.9 


3.2 


8-AP avg. 




3.2 


1.4 


42.2 


3.1 


2.4 


2.4 


2.6 


2.1 


1.4 


2.4 
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Tab. 3: Local search heuristics started from Trivial. 

Running time, ms 



Inst. 


2-opt 


3-opt 


v-opt 


1DV 


2DV 


sDV 


1DV 2 2DV 2 


sDV 3 


sDV, 


3gpl00 


6.2 


820.6 


181.8 


14.3 


14.0 


16.5 


18.4 


16.7 


430.6 


79.0 


3rl50 


19.8 


1 737.9 


65.7 


17.6 


18.7 


17.1 


22.7 


18.9 


147.8 


45.4 


4gpju 


1.5 


150 3 


45 


7 


1 2 


1 i 


1 A 
1 .4 


1 A 
1.4 


116 9 


17 5 


4r80 


105 


987.5 


64.5 


13 


18.0 


15.3 


I 1 O 

I I .Z 


1 Q A 


344.8 


98.2 


5gpl2 


0.3 


38.5 


3.6 


0.2 


0.4 


0.5 


U.J 


U.J 


30.6 


1.6 


5r40 


16.9 


425.9 


343 


2.3 


7.2 


6.3 


4.U 


ft.O 


386.9 


35.3 


6gp8 


0.2 


57.2 


2.5 


0.2 


03 


0.4 


n a 

U.4 


U.J 


42.0 


13 


6r22 


2.2 


218.9 


16.7 


0.9 


2.6 


3.9 


1 Q 
J .V 


A *Z 
4.J 


259.0 


22.7 


7gp5 


0.1 


48.9 


0.9 


0.1 


0.2 


0.3 


U. 1 


U.J 


40.0 


0.9 


7rl4 


1.4 


237.1 


12.0 


0.4 


1.6 


2.9 


1 8 


3 


210.9 


15.5 


8gp4 


0.1 


117.5 


0.8 


0.2 


0.3 


0.6 


2 


3 


72.3 


0.9 


8r9 


09 


191.9 


6.7 


03 


1.1 


2.3 


t Aj 


1 1 
3.1 


177.7 


7.1 


All avg. 


11 


419.4 


36.2 


11 


5.5 


5.6 


53 


6.3 


188.3 


27.1 


GP avg. 


1.4 


205.5 


39.1 


2.6 


2.7 


3.2 


3.5 


3.3 


122.1 


16.9 


Rand. avg. 


8i> 


633.2 


333 


4~9 


8.2 


7.9 


7.2 


9.4 


254.5 


37.4 


3-AP avg. 


13.0 


1 279.2 


123.8 


16.0 


16.4 


16.8 


20.5 


17.8 


289.2 


62.2 


4-AP avg. 


6.0 


568.9 


54.7 


4.3 


9.6 


8.2 


6.3 


9.9 


230.8 


57.8 


5-AP avg. 


8.6 


232.2 


19.0 


1.3 


3.8 


3.4 


2~!5 


4.5 


208.7 


18.5 


6-AP avg. 


1.2 


138.1 


9.6 


0.5 


1.5 


2.1 


TT 


2.4 


150.5 


12.0 


7-AP avg. 


0.7 


143.0 


6.5 


0.3 


0.9 


1.6 


To 


1.6 


125.5 


8.2 


8-AP avg. 


05 


154.7 


3.8 


03 


0.7 


1.4 


06 


1.7 


125.0 


4.0 


3cql50 


22.1 


4 366.5 


1 388.4 


42.1 


39.3 


34.9 


41.0 


46.0 


1 503.9 


497.6 


3gl50 


19.0 


2 229.3 


780.0 


26.2 


28.1 


25.5 


37.2 


33.0 


1 299.5 


201.2 


3pl50 


15.4 


2 149.7 


847.1 


82.0 


89.8 


89.7 


96.0 


101.9 


1 730.1 


458.6 


3srl50 


21.7 


3 949.9 


1 157.5 


36.0 


37.5 


37.9 


41.2 


47.1 


1 400.9 


469.6 


4cq50 


6J_ 


872.0 


308.9 


11 


8.5 


7.3 


11 


10.8 


468.0 


167.2 


4g50 


5.3 


542.9 


251.2 


3.7 


5.9 


5.9 


6.7 


6.6 


273.0 


873 


4p50 


5.7 


586.6 


251.2 


7.3 


14.2 


13.6 


13.4 


15.7 


441.5 


95.5 


4sr50 


5i> 


1 009.3 


296.4 


3.3 


7.4 


6.2 


6i) 


7.9 


424.3 


111.6 


5cq30 


4.6 


1 087 3 


177 7 


2.0 


5.2 


5.5 


3.3 


6.0 


560.0 


63.5 


5g30 


3/7 


673.9 


182.5 


L8 


4.1 


4.0 


JI 


5.7 


319.8 


41.8 


5p30 


4.5 


762.8 


103.6 


2.7 


10.1 


9.5 


6.1 


12.2 


580.3 


44.1 


5sr30 


4.8 


1 115.4 


163.5 


1.9 


4.7 


4.5 


3.6 


6.3 


667.7 


63.2 


6cql8 


11 


1 205.9 


63.4 


1.0 


2.7 


3.7 


1.5 


3.1 


630.2 


26.6 


6gl8 


2.0 


731.6 


55.2 


0.9 


1.8 


2.7 


1.9 


2.4 


346.3 


18.1 


6pl8 


3J. 


929.8 


31.1 


1.3 


3.8 


5.4 


2.5 


5.2 


658.3 


19.9 


6srl8 


2.3 


1 369.7 


59.9 


09 


2.9 


3.0 


1.5 


3.4 


778.4 


34.4 


7cql2 


1.7 


1 658.3 


31.7 


0.6 


2.0 


3.4 


1.2 


2.9 


728.5 


12.6 


7gl2 


1.4 


1 048.3 


28.2 


0.6 


1.3 


2.4 


1.1 


2.0 


555.4 


11.1 


7pl2 


2.1 


1 324.4 


17.5 


0.8 


2.4 


6.4 


1.8 


3.9 


1 088.9 


14.6 


7srl2 


1.9 


1 622.4 


40.9 


0.7 


2.0 


3.5 


1.1 


2.5 


965.6 


11.0 


8cq8 


1.1 


2112.3 


133 


0.5 


1.5 


2.8 


1.0 


2.0 


1 909.5 


8.5 


8g8 


1.0 


1 675.5 


15.6 


0.4 


0.8 


2.1 


0.8 


1.2 


728.5 


7.2 


8p8 


1.7 


2 051.4 


7.6 


0.4 


1.2 


3.1 


0.9 


1.8 


1 492.9 


7.9 


8sr8 


13 


2439.9 


16.4 


03 


13 


2.9 


L0 


1.8 


1 252.7 


8.1 


All avg. 


12 


1563.1 


262.0 


H 


11.6 


11.9 


11.7 


13.8 


866.8 


103.4 


Clique avg. 


6.5 


1 883.7 


330.6 


8.3 


9.9 


9.6 


9.0 


11.8 


966.7 


129.4 


Geom. avg. 


5.4 


1 150.2 


218.8 


5.6 


7.0 


7.1 


8.5 


8.5 


587.1 


61.1 


Product avg. 


5.4 


1 300.8 


209.7 


15.8 


20.2 


21.3 


20.1 


23.4 


998.7 


106.8 


SR avg. 


63 


1917.8 


289.1 


11 


9.3 


9.7 


21 


11.5 


914.9 


1163 


3-AP avg. 


19.5 


3 173.8 


1 0433 


46.6 


48.7 


47.0 


53.8 


57.0 


1 483.6 


406.8 


4-AP avg. 


5.7 


752.7 


276.9 


4.5 


9.0 


8.2 


8.0 


10.2 


401.7 


115.4 


5-AP avg. 


4.4 


909.9 


156.8 


2.1 


6.0 


5.9 


4.2 


7.5 


532.0 


53.2 


6-AP avg. 


2.7 


1 059.2 


52.4 


1.0 


2.8 


3.7 


1.9 


3.5 


603.3 


24.8 


7-AP avg. 


1.7 


1413.4 


29.6 


0.7 


1.9 


3.9 


1.3 


2.8 


834.6 


123 


8-AP avg. 


_L2 2 069.7 


13.2 


0.4 


1.2 


2.7 


0.9 


1.7 


1 345.9 


7.9 
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Tab. 4: Local search heuristics started from Greedy. 

Solution error, % Running times, ms 



Inst. 


2-opt 


1DV 


2DV 


sDV 


1DV 2 


2DV 2 


sDV 3 


sDV, 


2-opt 


1DV 


2DV 


sDV 


1DV 2 


2DV 2 


sDV 3 


sDV v 


3gpl00 


4.3 


3.4 


3.4 


3.4 


3.4 


3.4 


3.3 


3.4 


0.04 


0.04 


0.04 


0.04 


0.05 


0.05 


0.36 


0.09 


3rl50 


16.7 


1.2 


1.2 


1.2 


1.2 


1.2 


0.8 


07 


0.02 


0.02 


0.02 


0.03 


0.02 


0.03 


0.11 


0.05 


4gp30 


4.5 


3.7 


3.6 


3.6 


3.6 


3.6 


2.6 


3.6 


0.04 


0.03 


0.04 


0.04 


0.04 


0.04 


0. 1 1 


0.05 


4r80 


15.8 


7.9 


6.1 


6.1 


7.9 


6.1 


2.6 


1.5 


0.01 


0.02 


0.02 


0.02 


0.02 


0.02 


0.21 


0.08 


5gpl2 


5.4 


6.3 


4.5 


4.5 


5.3 


4.5 


1.8 


4.5 


0.01 


0.01 


0.01 


0.01 


0.01 


0.01 


0.03 


0.01 


5r40 


18.5 


19.8 


13.5 


13.5 


15.0 


13.5 


2.3 


3.5 


0.01 


0.01 


0.01 


0.01 


0.01 


0.01 


0.18 


0.04 


6gp8 


4.1 


8.9 


5.5 


4.3 


6.0 


4.5 


2.4 


3.8 


0.01 


0.01 


0.01 


0.01 


0.01 


0.01 


0.04 


0.01 


6r22 


25.9 


44.1 


28.6 


26.4 


26.8 


27.3 


2.7 


8.6 


0.01 


0.01 


0.01 


0.01 


0.01 


0.01 


0.21 


0.02 


7gp5 


5.5 


11.3 


7.0 


5.9 


6.6 


5.9 


3.5 


5.1 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.04 


0.00 


7rl4 


37.9 


88.6 


55.7 


33.6 


51.4 


44.3 


0.0 


15.0 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.14 


0.01 


8gp4 


4.2 


11.5 


5.2 


3.6 


4.2 


3.6 


3.1 


3.6 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.07 


0.00 


8r9 


40.0 


158.9 


107.8 


54.4 


65.6 


65.6 


0.0 


30.0 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.13 


0.01 


All avg. 


15.2 


30.5 


20.2 


13.4 


16.4 


15.3 


Zl 


6.9 


0.01 


0.01 


0.01 


0.01 


0.01 


0.01 


0.14 


0.03 


GP avg. 


A 1 
4. / 


f.D 


A Q 
4.V 


A 
4.Z 


A Q 
4.5 


4. J 




Z.o 


A f\ 
4.U 


n no 
u.uz 


n no 
u.uz 


n no 
u.uz 


n no 
u.uz 


n no 
u.uz 


n no 
u.uz 


n 1 1 

U. 1 1 


n ni 
\).\>j 


Rand. avg. 


Zj.O 


<1 A 


JJ.J 


00 *s 
ZZ. J 


oq n 

Zo.U 


OA 1 


1 A 
1.4 


Q Q 

y.y 


n m 


n m 

U.U1 


n ni 

U.U1 


n ni 

U.U1 


n m 

U.U1 


n ni 

U.U1 


n i fi. 

U. ID 


n ni 


3-AP avg. 


10.5 


2.3 


2.3 


2.3 


2.3 


2.3 


2.1 


2.0 


0.03 


0.03 


0.03 


0.04 


0.04 


0.04 


0.24 


0.07 


4-AP avg. 


10.1 


5.8 


4.9 


4.9 


5.7 


4.9 


2.6 


2.5 


0.02 


0.03 


0.03 


0.03 


0.03 


0.03 


0.16 


0.06 


5-AP avg. 


12.0 


13.0 


9.0 


9.0 


10.1 


9.0 


2.0 


4.0 


0.01 


0.01 


0.01 


0.01 


0.01 


0.01 


0.11 


0.02 


6-AP avg. 


15.0 


26.5 


17.1 


15.3 


16.4 


15.9 


2.6 


6.2 


0.01 


0.01 


0.01 


0.01 


0.01 


0.01 


0.13 


0.01 


7-AP avg. 


21.7 


49.9 


31.4 


19.7 


29.0 


25.1 


1.8 


10.0 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.09 


0.01 


8-AP avg. 


22.1 


85.2 


56.5 


29.0 


34.9 


34.6 


L6 


16.8 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.10 


0.01 


3cql50 


26.8 


8.1 


8.1 


8.1 


8.1 


8.1 


8.0 


8.0 


0.07 


0.07 


0.07 


0.07 


0.08 


0.08 


1.18 


0.26 


3gl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.07 


0.07 


0.07 


0.07 


0.08 


0.08 


1.09 


0.22 


3pl50 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


00 


0.0 


0.61 


0.65 


0.66 


0.66 


0.66 


0.66 


1.92 


0.96 




29.9 


9.8 


9.8 


9.8 


9.8 


9.8 


9.4 


9.1 


0.07 


0.07 


0.07 


0.07 


0.08 


0.09 


1.49 


0.26 


4cq50 


19.0 


11.6 


11.6 


11.6 


11.6 


11.6 


11.3 


1L6 


016 


0.16 


0.16 


0.16 


0.16 


0.16 


0.44 


0.21 


4g50 


00 


0.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.22 


0.22 


0.22 


0.22 


0.22 


0.22 


0.43 


0.29 


4p50 


0.1 


0.2 


0.1 


0.1 


0. 1 


0. 1 


0.0 


0. 1 


1 .04 


1 .04 


1.04 


1 .04 


1.04 


1.05 


1.39 


1.12 


4sr50 


on n 


i n o 

1U.V 


i i ^ 
ii.j 


1 1 3 
1 1.0 


i n q 


1 1 1 

LI. J 


i n 3 

1U. 


1 1.0 


0. 19 


0. 19 


0.20 


0.20 


0.20 


0.20 


0.47 


0.25 




1 A O 
14. z 


v.u 


V.J 


Q S 
y.j 




Q ^ 

y.j 


y.o 


Q A 

y.4 


n f.A 

U.D4 


n f.A 

U.D4 


n A/i 

U.04 


n aa 

U.D4 


n f^A 

U.04 


n f^A 

U.04 


i ni 

1 .UO 


n aq 


5g30 


0.0 


0.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.94 


0.94 


0.94 


0.94 


0.94 


0.94 


1.26 


0.97 


5p30 


0.0 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.72 


2.71 


2.72 


2.72 


2.72 


2.72 


3.23 


2.76 


5sr30 


11.7 


8.9 


8.5 


8.5 


8.3 


8.5 


7.1 


8.5 


0.67 


0.67 


0.67 


0.67 


0.67 


0.67 


1.23 


0.69 


6cql8 


9.8 


8.2 


7.8 


7.5 


7.9 


7.8 


6.3 


7.3 


0.43 


0.43 


0.43 


0.43 


0.43 


0.43 


1.08 


0.44 


6gl8 


0.0 


0.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.56 


0.56 


0.56 


0.57 


0.56 


0.57 


0.90 


0.58 


6pl8 


0.0 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.10 


1.10 


1.10 


1.10 


1.10 


1.10 


1.69 


1.12 


6srl8 


9.7 


8.6 


8.2 


8.2 


8.5 


8.2 


65 


7.8 


0.42 


0.42 


0.42 


0.42 


0.42 


0.42 


1.15 


0.44 


7cql2 


7.1 


5.7 


5.0 


5.1 


5.1 


5.0 


4.0 


4.9 


1.04 


1.04 


1.04 


1.04 


1.04 


1.04 


2.20 


1.05 


7gl2 


0.0 


0.5 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


1.22 


1.22 


1.22 


1.22 


1.22 


1.22 


1.77 


1.23 


7pl2 


0.0 


0.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.88 


1.87 


1.87 


1.88 


1.87 


1.88 


2.90 


1.89 


7srl2 


6.5 


5.7 


5.1 


5.2 


5.6 


5.1 


4.0 


5.0 


0.98 


0.98 


0.98 


0.98 


0.98 


0.98 


2.15 


0.99 


8cq8 


4.7 


4.1 


3.1 


2.8 


3.7 


2.7 


2.2 


2.6 


0.47 


0.47 


0.47 


0.47 


0.47 


0.47 


1.97 


0.47 


8g8 


0.0 


0.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.57 


0.57 


0.57 


0.57 


0.57 


0.57 


1.38 


0.58 


8p8 


0.0 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.71 


0.71 


0.71 


0.71 


0.71 


0.71 


2.11 


0.72 


8sr8 


3.2 


3.7 


2.8 


2.6 


2.6 


2.5 


2A 


2.4 


0.47 


0.47 


0.47 


0.48 


0.47 


0.48 


1.72 


0.48 


All avg. 


6.8 


4.1 


3.8 


3.8 


3.8 


3.8 


3A 


3.7 


0.72 


0.72 


0.72 


0.72 


072 


0.72 


1.51 


0.78 


Clique avg. 


13.6 


7.9 


7.5 


7.4 


7.6 


7.5 


6.8 


7.3 


0.47 


0.47 


0.47 


0.47 


0.47 


0.47 


1.32 


0.52 


Geom. avg. 


0.0 


0.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.60 


0.60 


0.60 


0.60 


0.60 


0.60 


1.14 


0.65 


Product avg. 


0.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.34 


1.35 


1.35 


1.35 


1.35 


1.35 


2.21 


1.43 


SR avg. 


13.5 


7.9 


7.6 


7.6 


7.6 


7.6 


6J, 


7.3 


0.47 


0.47 


0.47 


0.47 


0.47 


0.47 


1.37 


0.52 


3-AP avg. 


14.2 


4.5 


4.5 


4.5 


4.5 


4.5 


4.4 


4.3 


0.20 


0.22 


0.22 


0.22 


0.22 


0.23 


1.42 


0.43 


4-AP avg. 


9.8 


5.7 


5.7 


5.7 


5.6 


5.7 


5.4 


5.7 


0.40 


0.40 


0.41 


0.41 


0.40 


0.41 


0.68 


0.47 


5-AP avg. 


6.5 


4.8 


4.5 


4.5 


4.5 


4.5 


4.1 


4.5 


1.24 


1.24 


1.24 


1.24 


1.24 


1.24 


1.69 


1.27 


6-AP avg. 


4.9 


4.4 


4.0 


3.9 


4.1 


4.0 


3.2 


3.8 


0.63 


0.63 


0.63 


0.63 


0.63 


0.63 


1.21 


0.64 


7-AP avg. 


3.4 


3.1 


2.6 


2.6 


2.7 


2.5 


2.0 


2.5 


1.28 


1.28 


1.28 


1.28 


1.28 


1.28 


2.26 


1.29 


8-AP avg. 


2.0 


2.2 


1.5 


1.4 


1.6 


1.3 




1.3 


0.56 


0.55 


0.56 


0.56 


0.56 


0.56 


1.80 


0.56 
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Tab. 5: Chain metaheuristic started from Trivial, Greedy and ROM. 5 seconds given. 1 — 2-opt, 2 — 1DV, 
3 — 2DV, 4 — sDV, 5 — 1DV 2 , 6 — 2DV 2 , 7 — sDV 3 , 8 — sDV v . 

Solution error, % 



Trivial Greedy ROM 



Inst. 


1 


2 


3 


4 


5 


6 


7 


8 


1 


2 


3 


4 


5 


6 


7 


8 


1 


2 


3 


4 


5 


6 


7 


8 


3gpl00 


15.3 


1.8 


1.8 


1.8 


1.8 


1.8 


2.8 


2.5 


5.3 


1.7 


1.7 


1.7 


1.8 


1.8 


2.9 


2.3 


9.8 


1.9 


1.9 


1.9 


1.9 


1.9 


2.6 


2.3 


3rl50 


77.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.1 


0.0 


41.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


33.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4gp30 


7.0 


1.6 


1.1 


1.1 


1.8 


1.1 


0.8 


1.4 


6.3 


1.9 


0.8 


0.8 


1.8 


0.9 


0.8 


1.4 


2.2 


1.7 


0.9 


0.9 


1.7 


1.0 


0.8 


1.4 


4r80 


55.0 


4.4 


1.9 


1.9 


4.1 


2.3 


0.4 


0.0 


41.6 


4.6 


1.6 


1.6 


4.5 


1.8 


0.8 


0.0 


57.0 


4.3 


2.0 


2.0 


4.3 


2.0 


0.9 


0.0 


5gpl2 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


5r40 


40.8 


18.5 


8.0 


8.0 


16.3 


8.0 


0.0 


0.0 


34.0 


19.3 


8.0 


8.0 


13.5 


8.5 


0.0 


0.0 


40.3 


19.3 


8.0 


8.0 


15.8 


8.8 


0.5 


0.0 


6gp8 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


6r22 


20.5 


30.0 


10.9 


6.4 


15.5 


8.2 


0.0 


0.0 


19.1 


27.7 


11.8 


5.5 


15.5 


9.1 


0.0 


0.0 


15.5 


32.7 


13.6 


8.6 


15.0 


9.5 


0.0 


0.0 


7g P 5 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.1 


3.5 


3.5 


3.5 


3.5 


3.1 


3.5 


3.5 


3.5 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


7rl4 


2.9 


33.6 


11.4 


2.1 


6.4 


3.6 


0.0 


0.0 


3.6 


33.6 


10.7 


2.1 


5.7 


2.1 


0.0 


0.0 


4.3 


35.7 


7.9 


0.7 


2.1 


3.6 


0.0 


0.0 


8gp4 


2.1 


5.2 


4.7 


4.2 


2.1 


3.6 


5.2 


5.2 


0.5 


3.1 


3.1 


3.1 


2.6 


1.6 


3.1 


2.6 


1.0 


4.7 


4.7 


3.6 


2.6 


4.2 


4.7 


4.7 


8r9 


O0 


25.6 


4.4 


OO 


O0 


O0 


O0 


O0 


O0 


22.2 


2.2 


O0 


O0 


O0 


O0 


OO 


O0 


26.7 


4.4 


O0 


O0 


O0 


O0 


O0 


All £iv^ 


19.1 


10.7 


4.3 


2.8 


4.6 


3.0 


1.4 


1.4 


13.2 


10.1 


4.0 


2.5 


4.4 


2.7 


1 .2 


I 1 


14.3 


1 1.2 


4.3 


2.8 


4.3 


3.2 


1.4 


1.3 


GP avg. 


5.4 


2.7 


2.6 


2.5 


2.2 


2.4 


2.8 


2.8 


3.2 


2.4 


2.2 


2.2 


2.3 


1.9 


2.4 


2.3 


3.4 


2.7 


2.5 


2.4 


2.3 


2.5 


2.6 


2.7 


Rand. avg. 


32.8 


18.7 


6.1 


3.1 


7.0 


3.7 


0.1 


O0 


23.3 


17.9 


5.7 


2.9 


6.5 


3.6 


0.1 


O0 


25.1 


19.8 


6.0 


3.2 


6.2 


4.0 


0.2 


O0 


3-AP avg. 


46.5 


0.9 


0.9 


0.9 


0.9 


0.9 


1.4 


1.2 


23.3 


0.9 


0.9 


0.9 


0.9 


0.9 


1.4 


1.1 


21.7 


0.9 


0.9 


0.9 


1.0 


1.0 


1.3 


1.1 


4-AP avg. 


31.0 


3.0 


1.5 


1.5 


3.0 


1.7 


0.6 


0.7 


23.9 


3.3 


1.2 


1.2 


3.1 


1.3 


0.8 


0.7 


29.6 


3.0 


1.4 


1.4 


3.0 


1.5 


0.8 


0.7 


5-AP avg. 


21.1 


10.0 


4.8 


4.8 


8.9 


4.8 


0.8 


0.8 


17.8 


10.4 


4.8 


4.8 


7.5 


5.0 


0.8 


0.8 


20.9 


10.4 


4.8 


4.8 


8.6 


5.1 


1.0 


0.8 


6-AP avg. 


11.4 


16.2 


6.7 


4.4 


8.9 


5.3 


1.2 


1.2 


10.7 


15.1 


7.1 


3.9 


8.9 


5.7 


1.2 


1.2 


8.9 


17.6 


8.0 


5.5 


8.7 


6.0 


1.2 


1.2 


7-AP avg. 


3.4 


18.7 


7.7 


3.0 


5.2 


3.7 


2.0 


2.0 


3.3 


18.5 


7.1 


2.8 


4.6 


2.6 


1.8 


1.8 


3.9 


19.8 


5.9 


2.3 


3.0 


3.7 


2.0 


2.0 


8-AP avg. 


1.0 


15.4 


4.6 


2.1 


1.0 


1.8 


2.6 


2.6 


0.3 


12.7 


2.7 


1.6 


1.3 


0.8 


1.6 


1.3 


0.5 


15.7 


4.6 


1.8 


1.3 


2. 1 


2.3 


2.3 


3cql50 


80.7 


6.2 


6.2 


6.2 


6.7 


6.7 


17.0 


9.8 


38.2 


6.0 


6.0 


6.0 


6.1 


6.0 


8.4 


6.3 


36.8 


6.4 


6.4 


6.4 


6.5 


6.5 


15.8 


11.3 


3gl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3pl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


O0 


0.0 


3srl50 


96.0 


7.0 


7.0 


7.1 


7.6 


7.6 


18.3 


11.8 


41.0 


7.4 


7.4 


7.4 


7.9 


7.9 


9.1 


7.4 


42.8 


6.7 


6.7 


6.8 


7.0 


7.2 


17.8 


11.4 


4cq50 


27.7 


5A 


5JS 


5.8 


5.6 


6.1 


12.7 


9.5 


22.5 


Ti 


5/7 


5J 


6.1 


5.8 


9.8 


TA 


26.4 


5A 


52 


5.0 


5.4 


5.6 


13.0 


8.0 


4g50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4p50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4sr50 


31.9 


6.4 


7.1 


7.1 


7.3 


7.4 


14.4 


8.8 


23.3 


6.6 


7.2 


7.2 


7.6 


7.4 


9.2 


7.6 


30.0 


6.5 


7.1 


7.1 


7.3 


7.3 


13.5 


10.4 


5cq30 


11.6 


2.7 


2.5 


2.4 


2.7 


2.5 


8.3 


4.4 


11.8 


23 


2.7 


2.6 


2.9 


2.8 


5.6 


3.9 


11.9 


26 


2.8 


2.6 


2.9 


3.1 


9.0 


4.8 


5o30 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


5p30 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 





0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


5sr30 


15.3 


4.1 


4 1 


3.8 


5 1 


4.2 


10.5 


6 6 


13.5 


4.2 


4.0 


4.0 


4.9 


4.2 


7.4 


6.0 


14.9 


4.3 


4.7 


4.5 


4.6 


4.7 


9.8 


5.9 


6cql8 


3.2 


0.3 


2 


4 


5 


3 


5 9 


1 .4 


3 3 


3 


3 


0.4 


0.4 


5 


4.4 


I 5 


2.7 


0.4 


0.3 


0.4 


0.6 


0.2 


6.5 


1.3 


fiol 8 

UglO 


0.0 


0.0 





0.0 


0.0 


0.0 





0.0 





0.0 


0.0 





0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


6pl8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


6srl8 


4.1 


0.7 


0.5 


0.8 


1.2 


1.1 


7.6 


1.9 


4.0 


1.0 


0.9 


0.7 


0.9 


0.9 


5.7 


2.5 


4.2 


1.1 


0.7 


1.0 


1.2 


0.7 


7.1 


2.4 


7cql2 


0.5 


0.0 


0.0 


0.0 


0.0 


0.0 


3.8 


0.3 


0.4 


0.0 


0.0 


0.0 


0.0 


0.0 


2.7 


0.4 


0.4 


00 


0.0 


0.1 


0.0 


0.0 


4.3 


0.2 


7gl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7pl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7srl2 


0.6 


0.0 


0.0 


0.0 


0.1 


0.0 


4.6 


0.4 


0.7 


0.0 


0.0 


0.1 


0.0 


0.1 


3.4 


0.6 


0.4 


0.0 


0.0 


0.1 


0.0 


0.1 


5.1 


0.3 


8cq8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.9 


0.0 


8g8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8p8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8sr8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.4 


00 


All avg. 


11.3 


IA 


1.4 


1.4 


1.5 


1.5 


4.5 


2.3 


6.6 


1A 


1.4 


1.4 


1.5 


1.5 


2.9 


1.8 


7.1 


L4 


1.4 


1.4 


1.5 


1.5 


4.4 


2.3 


Clique avg. 


20.6 


2.4 


2.4 


2.5 


2.6 


2.6 


8.3 


4.2 


12.7 


2.3 


2.4 


2.5 


2.6 


2.5 


5.6 


3.2 


13.0 


2.4 


2.4 


2.4 


2.6 


2.6 


8.4 


4.3 


Geom. avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Product avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


SR avg. 


24.6 


3J) 


3.1 


3.1 


3.5 


3.4 


9.6 


4.9 


13.7 


30. 


3.2 


3.2 


3.5 


3.4 


6.1 


4.0 


15.4 


li 


3.2 


3.2 


3.4 


3.3 


9.3 


5.0 


3-AP avg. 


44.2 


3.3 


3.3 


3.3 


3.6 


3.6 


8.8 


5.4 


19.8 


3.4 


3.4 


3.4 


3.5 


3.5 


4.4 


3.4 


19.9 


3.3 


3.3 


3.3 


3.4 


3.4 


8.4 


5.7 


4-AP avg. 


14.9 


3.0 


3.2 


3.2 


3.2 


3.4 


6.8 


4.6 


11.4 


3.0 


3.2 


3.2 


3.4 


3.3 


4.8 


3.8 


14.1 


2.9 


3.1 


3.0 


3.2 


3.2 


6.6 


4.6 


5-AP avg. 


6.7 


1.7 


1.7 


1.6 


1.9 


1.7 


4.7 


2.7 


6.3 


1.6 


1.7 


1.6 


2.0 


1.8 


3.2 


2.5 


6.7 


1.8 


1.9 


1.8 


1.9 


1.9 


4.7 


2.7 


6-AP avg. 


1.8 


0.3 


0.2 


0.3 


0.4 


0.3 


3.4 


0.8 


1.8 


0.3 


0.3 


0.3 


0.3 


0.3 


2.5 


1.0 


1.7 


0.4 


0.3 


0.4 


0.5 


0.2 


3.4 


0.9 


7-AP avg. 


0.3 


0.0 


0.0 


0.0 


0.0 


0.0 


2.1 


0.2 


0.3 


0.0 


0.0 


0.0 


0.0 


0.0 


1.5 


0.2 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


2.4 


0.1 


8-AP avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.1 


0.0 
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Tab. 6: Chain metaheuristic started from Trivial, Greedy and ROM. 10 seconds given. 1 — 2-opt, 2 — 
1DV, 3 — 2DV, 4 — sDV, 5 — 1DV 2 , 6 — 2DV 2 , 7 — sDV 3 , 8 — sDV v . 

Solution error, % 



Trivial Greedy ROM 



Inst. 


1 


2 


3 


4 


5 


6 


7 


8 


1 


2 


3 


4 


5 


6 


7 


8 


1 


2 


3 


4 


5 


6 


7 


8 


3gpl00 


15.1 


1.6 


1.6 


1.6 


1.7 


1.7 


2.3 


2.2 


5.3 


1.6 


1.6 


1.6 


1.6 


1.6 


2.5 


2.1 


9.8 


1.6 


1.6 


1.6 


1.8 


1.7 


2.2 


2.1 


3rl50 


75.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


41.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


33.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4gp30 


6.5 


1.4 


0.8 


0.8 


1.3 


1.0 


0.7 


1.3 


6.2 


1.7 


0.8 


0.8 


1.5 


0.8 


0.7 


1.1 


2.2 


1.4 


0.8 


0.8 


1.4 


0.8 


0.7 


1.2 


4r80 


52.1 


3.9 


1.1 


1.0 


3.6 


1.1 


0.1 


0.0 


41.4 


3.9 


1.0 


1.0 


4.3 


1.1 


0.4 


0.0 


55.0 


4.0 


1.1 


1.1 


3.4 


1.3 


0.4 


0.0 


5gpl2 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


5r40 


36.5 


16.3 


6.5 


5.8 


13.0 


6.8 


0.0 


0.0 


32.3 


18.8 


7.0 


7.0 


13.0 


7.0 


0.0 


0.0 


36.8 


16.5 


6.8 


6.8 


13.8 


7.3 


0.0 


0.0 


6gp8 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


6r22 


16.8 


27.7 


9.1 


5.0 


12.3 


7.7 


0.0 


0.0 


15.5 


26.8 


11.4 


4.5 


13.2 


8.2 


0.0 


0.0 


14.1 


30.0 


10.5 


5.9 


12.3 


8.6 


0.0 


0.0 


7gp5 


3.5 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.1 


3.5 


3.5 


3.5 


3.5 


3.1 


3.5 


3.5 


2.7 


3.9 


3.9 


3.9 


3.9 


3.5 


3.9 


3.9 


7rl4 


1.4 


29.3 


7.1 


1.4 


2.9 


2.9 


0.0 


0.0 


0.7 


31.4 


6.4 


0.7 


4.3 


0.0 


0.0 


0.0 


2.9 


29.3 


5.7 


0.7 


0.0 


2.1 


0.0 


0.0 


8gp4 


1.6 


5.2 


4.7 


3.6 


1.0 


2.1 


5.2 


3.6 


0.5 


3.1 


2.1 


2.6 


1.6 


1.6 


2.6 


2.6 


1.0 


4.7 


4.7 


3.6 


1.0 


2.1 


4.2 


4.2 


8r9 


00 


23.3 


1.1 


oo 


OO 


OO 


OO 


OO 


OO 


15.6 


1.1 


oo 


OO 


oo 


oo 


OO 


OO 


22.2 


4.4 


oo 


oo 


oo 


OO 


oo 


All civ^ 


17 7 


9 7 


3 3 


2 ^ 


3 6 


2 6 


1 3 


1 2 


12 5 


9 2 


3 2 


2 1 


3 9 


2 3 


1 j 




13 5 


9 8 


3 6 


2 4 


3 5 


2 6 


1 3 


1 3 


GP avg. 


5.1 


2.7 


2.5 


2.3 


2.0 


2.1 


2.7 


2.5 


3.2 


2.3 


2.0 


2.1 


2.0 


1.8 


2.2 


2.2 


3.3 


2.6 


2.5 


2.3 


2.0 


2.0 


2.5 


2.5 


Rand. avg. 


30.4 


16.7 


4.2 


2.2 


5.3 


3.1 


0.0 


OO 


21.9 


16.1 


4.5 


2.2 


5.8 


2.7 


0.1 


00 


23.7 


17.0 


4.7 


2.4 


4.9 


3.2 


0.1 


oo 


3-AP avg. 


45.2 


0.8 


0.8 


0.8 


0.9 


0.9 


1.1 


1.1 


23.3 


0.8 


0.8 


0.8 


0.8 


0.8 


1.3 


1.0 


21.7 


0.8 


0.8 


0.8 


0.9 


0.9 


1.1 


1.1 


4-AP avg. 


29.3 


2.7 


1.0 


0.9 


2.5 


1.0 


0.4 


0.7 


23.8 


2.8 


0.9 


0.9 


2.9 


0.9 


0.5 


0.6 


28.6 


2.7 


1.0 


1.0 


2.4 


1.0 


0.5 


0.6 


5-AP avg. 


19.0 


8.9 


4.0 


3.6 


7.3 


4.1 


0.8 


0.8 


16.9 


10.1 


4.3 


4.3 


7.3 


4.3 


0.8 


0.8 


19.1 


9.0 


4.1 


4.1 


7.6 


4.4 


0.8 


0.8 


6-AP avg. 


9.6 


15.1 


5.7 


3.7 


7.3 


5.1 


1.2 


1.2 


8.9 


14.6 


6.9 


3.5 


7.8 


5.3 


1.2 


1.2 


8.2 


16.2 


6.4 


4.2 


7.3 


5.5 


1.2 


1.2 


7-AP avg. 


2.5 


16.6 


5.5 


2.7 


3.4 


3.4 


2.0 


2.0 


1.9 


17.5 


5.0 


2.1 


3.9 


1.6 


1.8 


1.8 


2.8 


16.6 


4.8 


2.3 


2.0 


2.8 


2.0 


2.0 


8-AP avg. 


0.8 


14.3 


2.9 


1.8 


0.5 


1.0 


2.6 


1.8 


0.3 


9.3 


1.6 


1.3 


0.8 


0.8 


1.3 


1.3 


0.5 


13.5 


4.6 


1.8 


0.5 


1.0 


2.1 


2.1 


3cql50 


79.8 


5.4 


5.4 


5.4 


5.9 


5.9 


13.3 


8.3 


38.2 


5.6 


5.6 


5.6 


5.7 


5.8 


7.9 


6.1 


36.8 


6.1 


5.9 


5.9 


6.3 


6.2 


12.7 


8.2 


3gl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3pl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3srl50 


93.9 


6.3 


6.3 


6.3 


6.7 


6.7 


15.8 


10.2 


41.0 


6.2 


6.2 


6.2 


6.6 


6.6 


8.3 


7.2 


42.8 


6.6 


6.5 


6.5 


6.7 


6.7 


14.5 


9.1 


4cq50 


26.2 


53 


5i) 


A3 


5.2 


5.3 


9.9 


6.5 


22.4 


4i) 


53 


53 


5.4 


5.5 


8.9 


7.0 


25.5 


4.6 


18 


4~8 


5.2 


4.9 


11.3 


7.1 


4g50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4p50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4sr50 


30.8 


5J3 


6.6 


6.6 


6.5 


6.9 


11.2 


8.2 


23.3 


6A 


6.5 


6.5 


6.7 


6.6 


8.9 


6.7 


29.3 


6.2 


61 


<u 


6.9 


6.7 


11.3 


9.2 


5cq30 


10.9 


2.2 


1.9 


2.0 


2.0 


2.1 


6.9 


4.2 


11.0 


1.9 


2.2 


2.2 


2.3 


2.5 


5.1 


3.4 


11.4 


2.4 


2.3 


2.3 


2.4 


2.4 


7.3 


3.7 


5ct30 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


5p30 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 





5sr30 


13.8 


3.7 


3.5 


3.2 


3.9 


35 


8.9 


5.0 


12.2 


3.9 


3.5 


3.5 


4.0 


3.7 


6.3 


4.9 


14.0 


4.0 


4.0 


4.0 


3.8 


4.2 


8 6 


4.8 


6cql8 


2 5 


1 


1 


3 


4 


1 


4.1 


8 


2 7 


3 


2 





2 


0.4 


3.5 


0.8 


2.3 


0.2 


0. 1 


0.2 


0.2 


0.2 


4.8 


1 


6ct1 8 











0.0 


0.0 


0.0 





0.0 





0.0 


0.0 





0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


6pl8 


00 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


6srl8 


3.4 


0.4 


0.4 


0.4 


0.7 


0.8 


5.1 


1.0 


3.4 


0.7 


0.7 


0.3 


0.6 


0.6 


4.8 


2.0 


3.8 


0.5 


0.6 


0.5 


0.8 


0.6 


5.5 


1.8 


7cql2 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


2.7 


0.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


2.1 


0.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


3.4 


0.1 


7gl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7pl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7srl2 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


3.5 


0.1 


0.5 


0.0 


0.0 


0.1 


0.0 


0.0 


2.4 


0.2 


0.3 


0.0 


0.0 


0.1 


0.0 


0.0 


4.1 


0.2 


8cq8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.4 


0.0 


8g8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8p8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8sr8 


oo 


oo 


oo 


oo 


oo 


oo 


1.4 


oo 


OO 


oo 


oo 


oo 


oo 


oo 


1.4 


oo 


oo 


oo 


oo 


OO 


oo 


oo 


2.1 


oo 


All avg. 


10.9 


1.2 


1.2 


12 


1.3 


1.3 


3.5 


1.9 


6.5 


1.3 


1.3 


_L2 


1.3 


1.3 


2.5 


1.6 


6.9 


1.3 


LI 


1.3 


1.4 


1.3 


3.6 


1.9 


Clique avg. 


19.9 


2.1 


2.1 


2.1 


2.2 


2.3 


6.4 


3.3 


12.4 


2.1 


2.2 


2.2 


2.3 


2.4 


4.8 


2.9 


12.7 


2.2 


2.2 


2.2 


2.4 


2.3 


6.8 


3.3 


Geom. avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Product avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


SR avg. 


23.7 


2/7 


2.8 


2.7 


3.0 


3.0 


7.7 


4.1 


13.4 


2.9 


2.8 


Z8 


3.0 


2.9 


5.3 


3.5 


15.0 


2.9 


2.9 




3.0 


3.0 


7.7 


4.2 


3-AP avg. 


43.4 


2.9 


2.9 


2.9 


3.1 


3.1 


7.3 


4.6 


19.8 


3.0 


3.0 


3.0 


3.1 


3.1 


4.0 


3.3 


19.9 


3.2 


3.1 


3.1 


3.2 


3.2 


6.8 


4.3 


4-AP avg. 


14.2 


2.7 


2.9 


2.9 


2.9 


3.1 


5.3 


3.7 


11.4 


2.8 


2.9 


2.9 


3.0 


3.0 


4.4 


3.4 


13.7 


2.7 


2.7 


2.7 


3.0 


2.9 


5.7 


4.1 


5-AP avg. 


6.2 


1.5 


1.3 


1.3 


1.5 


1.4 


3.9 


2.3 


5.8 


1.5 


1.4 


1.4 


1.6 


1.6 


2.8 


2.1 


6.4 


1.6 


1.6 


1.6 


1.6 


1.7 


4.0 


2.1 


6-AP avg. 


1.5 


0.1 


0.1 


0.2 


0.3 


0.3 


2.3 


0.5 


1.5 


0.2 


0.2 


0.1 


0.2 


0.3 


2.1 


0.7 


1.5 


0.2 


0.2 


0.2 


0.3 


0.2 


2.6 


0.7 


7-AP avg. 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


1.5 


0.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


1.1 


0.1 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


1.9 


0.1 


8-AP avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.9 


0.0 
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Tab. 7: Multichain metaheuristic started from Trivial, Greedy and ROM. 5 seconds given. 1 — 2-opt, 2 — 
1DV, 3 — 2DV, 4 — sDV, 5 — 1DV 2 , 6 — 2DV 2 , 7 — sDV 3 , 8 — sDV v . 

Solution error, % 



Trivial Greedy ROM 



Inst. 


1 
1 


z 


•7 
J 


4 


J 





7 


Q 
O 


1 


J 

z 


•3 
J 


4 


J 


O 


7 


O 


1 
1 


z 


•3 


A 

4 


J 





7 


Q 
O 


3gpl00 


11.8 


1.1 


1.2 


1.1 


1.3 


1.3 


156.9 


2.0 


5.3 


1.2 


1.2 


1.1 


1.4 


1.3 


5.6 


2.2 


9.7 


1.2 


1.2 


1.2 


1.3 


1.3 


9.8 


2.0 


3rl50 


68.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


41.4 


0.0 


0.0 


0.0 


0.0 


().() 


0.0 


0.0 


33.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4gpjU 


3 


9 


7 


7 


8 


7 


7 


1 1 


3 1 


8 


7 


7 


1 


7 


7 


1 


2 1 


7 


7 


7 


7 


7 


8 


1 


/1i-Qfl 
4r8U 


4 3. J 


1 A 
J. 4 


1.3 


1 A 
1 .4 


Z.J 


1 .5 


n a 

U.4 


A A 

u.u 


jo.y 


j.j 


A Q 

u.y 


() Q 

u.y 


J. 1 


A O 

u.y 


A ft 
U.o 


A A 
U.U 


AA A 
44.0 


7 A 
Z.4 


1 n 
1 ,u 


1 n 
1 ,u 


7 A 
Z.O 


1 . 1 


A ^ 1 
4 J.J 


A A 

u.u 


->gplZ 


1 ^ 
1.3 


1 c 
1 .J 


1 ^ 
1 .J 


1 c 
1.3 


1 .j 


1 .5 


1 c 
1.3 


1 .J 


1 .J 


i ^ 
l .j 


1 c 
1.3 


1.5 


1 c 
1 .3 


1 . j 


1.5 


1.5 


1.5 


l.J 


1 .5 


1 .5 


1.5 


1 .5 


1.5 


1 . J 


5r40 


26 


15 3 


5 3 


5 5 


10 8 


6 3 


516 8 





26 8 


14 5 


5 1 


5 8 


10 


5 








28 3 


15 3 


6 8 


6 8 


110 


7 


152 5 





6gp8 


7 A 
Z.4 


7 A 
Z.4 


7 /l 
Z.4 


j -1 

Z.4 


7 A 
Z.4 


•7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


7 -1 
Z.4 


•7 A 
Z.4 


7 A 
Z.4 


1 A 
^.4 


7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


O A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


7 A 
Z.4 


6r22 


ft A 
O.O 


on n 
zu.u 


A ft 


A S 
4. J 


7 7 


^ Q 

j.y 








y. i 


7A Q 

zu.y 


7 7 


2 7 


7 1 
l.J 


4.J 








6 4 


20 5 


8 6 


5 5 


9 5 


5 


30 


o 




J.y 


'X Q 
j.y 


J.J 


1 Q 

j.y 


j.y 


^ Q 

j.y 


j.y 


j.y 


3 5 


J.J 


J.J 


J.3 


J.J 


J.J 


3 5 


3 5 


3 9 


3 9 


3 9 


3 9 


3 9 


3 5 


3 9 


j.y 


7rl4 


a a 


1 ft a 

1 o.O 


/ . 1 


u. / 


a a 
u.u 


2 1 


n n 
u.u 


A A 

u.u 


A A 
U.U 


7^ A 
ZJ.u 


ft A 
o.O 


1 4 


A 7 
U. / 


7 Q 

z.y 


A A 

u.u 


A A 

u.u 


A A 

u.u 


21 4 


7 1 


2 1 


u.u 


2 1 


A A 

u.u 


A A 

u.u 


8gp4 


7 1 
Z. 1 


7 

J.Z 


A 1 
4. / 


A 7 
4.Z 


Z. 1 


A O 
4.Z 


i a 

J.O 


A 7 
4.Z 


1 A 
1.0 


1 A 
J.O 


1 A 
Z.O 


7 A 
Z.O 


1 1 
Z. 1 


1 A 
1 .0 


1 A 
J.O 


1 1 
J.l 


a 

U.J 


A 1 
4. / 


^ j 

J.Z 


A 
4.Z 


1 A 
Z.O 


A 1 
4. / 


A n 

4. / 


1 A 
J.O 


ory 


u.u 


14 4 


1 1 


n n 
u.u 


a a 
u.u 


u.u 


u.u 


A A 
U.U 


A A 
U.U 


17 ft 
1 / .6 


2 2 


u.u 


A A 
U.U 


A A 
U.U 


A A 
U.U 


A A 
U.U 


A A 

u.u 


14 4 


2 2 


u.u 


u.u 


A A 
U.U 


A A 
U.U 


A A 
U.U 


All avg. 


14.4 


7.2 


3.1 


2.2 


2.7 


2.5 


57.2 


L3 


n.i 


7.8 


3.0 


1.9 


2.7 


2.0 


1.5 


Li 


11.1 


7.4 


3.4 


2.4 


3.0 


2.5 


20.9 


12 


GP avg. 


4.1 


2.5 


2.3 


2.3 


2.0 


2.3 


28.2 


2.5 


2.9 


2.2 


2.0 


2.0 


2.0 


1.8 


2.9 


2.3 


3.4 


2.4 


2.5 


2.3 


2.1 


2.4 


3.8 


2.4 


Rand. avg. 


24.7 


11.9 


3.8 


2.0 


3.5 


2.6 


86.2 


0.0 


19.4 


13.3 


4.1 


1.8 


3.5 


2.2 


0.1 


0.0 


18.8 


12.3 


4.3 


2.6 


3.9 


2.5 


38.0 


0.0 


3-AP avg. 


40.0 


0.6 


0.6 


0.6 


0.6 


0.6 


78.5 


1.0 


23.3 


0.6 


0.6 


0.6 


0.7 


0.7 


2.8 


1.1 


21.7 


0.6 


0.6 


0.6 


0.7 


0.7 


4.9 


1.0 


4-AP avg. 


24.1 


2.1 


1.1 


1.0 


1 .5 


1.1 


0.5 


0.6 


21.0 


2.0 


0.8 


0.8 


2.0 


0.8 


0.7 


0.5 


23.3 


1.5 


0.8 


0.8 


1.7 


0.9 


23.0 


0.5 


5-AP avg. 


13.8 


8.4 


3.4 


3.5 


6. 1 


3.9 


259~T 


0.8 


14.1 


8.0 


3.4 


3.6 


5.8 


3.3 


0.8 


08 


14.9 


8.4 


4.1 


4.1 


6.3 


4.3 


77.0 


08 


6-AP avg. 


5.5 


1 1.2 


4.6 


3.5 


5.1 


4.2 


1.2 


~L2 


5.7 


11.7 


5.1 


2.6 


4.8 


3.5 


1.2 


1.2 


4.4 


1 1.4 


5.5 


3.9 


6.0 


3.7 


16.2 


T/2 


7-AP avg. 


2.0 


11.2 


5.3 


2.3 


2.0 


3.0 


2/0 


2/0 


1.8 


13.5 


6.0 


2.5 


2.1 


3.2 


L8 


T8 


2.0 


12.7 


5.5 


3.0 


2.0 


2.8 


2.0 


2/j 


8-AP avg. 


T7j 


9.8 


3.5 


2.1 


T7j 


2.1 


L8 


2~l 


08 


10.7 


2.4 


1.3 


1.0 


0.8 


~L8 


T6 


03 


9.6 


3.7 


2. 1 


73 


2.3 


23 


TTs 


3cql50 


75.2 


3.9 


3.8 


3.7 


4.4 


4.3 


1219.1 


491.9 


38.2 


2.5 


2.5 


2.5 


3.1 


3.0 


41.1 


20.9 


36.8 


3.9 


3.8 


3.7 


4.8 


4.8 


36.8 


24.2 


3gl50 


00 


O0 


00 


00 


O0 


OO 


865.3 


OO 


OO 


OO 


00 


OO 


OO 


00 


19.5 


OO 


OO 


OO 


OO 


OO 


OO 


OO 


2.9 


OO 


3pl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


76.3 


76.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


215.3 


215.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7.2 


7.2 


3srl50 


85.8 


4.5 


4.3 


4.5 


5.6 


5.5 


1249.7 


630.5 


41.0 


3.2 


3.2 


3.2 


3.4 


3.3 


41.9 


7.4 


42.8 


4.0 


3.9 


4.0 


4.9 


4.9 


42.8 


32.7 


4cq50 


12.7 


2J5 


4.4 


4.2 


3.6 


4.8 


283.6 


9.7 


106 


15 


2.9 


2.9 


2.5 


3.5 


13.9 


6.6 


13.5 


3.8 


32 


32 


3.8 


3.6 


28.4 


9.6 


4g50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4p50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


102.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


484.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8.3 


0.0 


4sr50 


16.4 


3.0 


3.4 


3.5 


3.1 


3.9 


155.4 


10.7 


13.7 


2.1 


3.0 


3.1 


2.2 


3.4 


19.5 


7.1 


15.9 


3.8 


4.2 


4.0 


3.9 


4.8 


29.2 


10.5 


5cq30 


3.4 


2.1 


1 .4 


1.4 


3.0 


1 .6 


154.5 


4.4 


3.6 


2.0 


2.2 


2.2 


2.3 


2.2 


20.2 


3.2 


4.1 


2.2 


2.2 


2.2 


2.7 


2.3 


21.2 


4.6 


5g30 


0.0 


0.0 


0.0 


00 


0.0 


0.0 


0.0 


0.0 


0.0 


OO 


0.0 


0.0 


0.0 


0.0 


2.3 


0.0 


0.0 


0.0 


OO 


0.0 


0.0 


0.0 


0.0 


0.0 


5p30 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


137.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1016.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7.6 


0.0 


5sr30 


6.0 


2.4 


3.4 


3.4 


2.7 


3.6 


195.6 


5.3 


4.6 


2.3 


2.3 


2.2 


2.2 


2.4 


15.8 


4.2 


4.7 


3.4 


3.1 


3.2 


3.9 


3.4 


27.6 


6.4 


6cql8 


2.8 


2.1 


2.0 


1.4 


1.8 


1.8 


141.9 


3.0 


1.9 


1.6 


1.5 


1.5 


1.7 


1.2 


15.4 


2.3 


2.7 


2.2 


1.9 


1.8 


1.4 


2.1 


18.1 


2.3 


6gl8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


260.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


26.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.6 


0.0 


6pl8 


00 


0.0 


0.0 


0.0 


oo 


OO 


162.9 


0.0 


0.0 


0.0 


0.0 


0.0 


OO 


00 


2117.7 


0.0 


OO 


0.0 


0.0 


0.0 


OO 


0.0 


7.8 


0.0 


6srl8 


3.8 


1.9 


2.4 


2.2 


2.3 


2.3 


120.7 


3.5 


3.0 


2.0 


2.1 


2.0 


2.1 


2.1 


13.2 


2.6 


3.9 


2.3 


1.8 


2. 1 


2.7 


1.7 


19.1 


3.0 


7cql2 


0.9 


1.0 


1.0 


1.0 


0.5 


0.9 


91.5 


1.2 


0.7 


0.6 


0.7 


0.6 


0.8 


0.4 


13.8 


0.6 


1.1 


0.8 


0.2 


0.9 


0.8 


0.3 


14.8 


1.1 


7gl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


156.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


18.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.4 


0.0 


7pl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


346.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3161.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


9.2 


0.0 


7srl2 


1.1 


1.4 


0.9 


1.2 


1.0 


1.1 


77.7 


09 


1.4 


1.0 


1.1 


1.1 


0.6 


0.7 


9.4 


1.2 


1.8 


1.1 


0.7 


0.8 


1.0 


1.0 


14.9 


1.2 


8cq8 


0.1 


0.3 


0.2 


0.2 


0.1 


0.4 


62.3 


0.2 


0.2 


0.2 


0.1 


0.2 


0.1 


0.1 


10.4 


0.3 


0.2 


0.3 


0.2 


0.3 


0.2 


0.2 


9.9 


0.3 


8g8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


104.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


14.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.4 


0.0 


8p8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


176.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3604.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


9.0 


0.0 


8sr8 


0.5 


0.2 


0.3 


0.4 


01 


0.2 


51.9 


0.3 


0.2 


0.5 


0.4 


0.4 


02 


0.3 


6.6 


0.6 


0.3 


0.5 


0.3 


0.6 


02 


0.3 


9.8 


0.4 


All avg. 


8.7 


LI 


1.1 


1.1 


1.2 


1.3 


258.0 


51.6 


5.0 


08 


0.9 


0.9 


0.9 


0.9 


454.3 


11.3 


5.3 


1.2 


u 


1.1 


1.3 


1.2 


13.8 


4.3 


Clique avg. 


15.9 


2.0 


2.1 


2.0 


2.2 


2.3 


325.5 


85.1 


9.2 


1.5 


1.7 


1.7 


1.8 


1.7 


19.1 


5.6 


9.7 


2.2 


1.9 


2.0 


2.3 


2.2 


21.5 


7.0 


Geom. avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


231.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


13.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.5 


0.0 


Product avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


167.0 


12.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1766.7 


35.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8.2 


1.2 


SR avg. 


18.9 


23 


2.5 


2.5 


2.5 


2.8 


308.5 


108.5 


10.7 


1.8 


2.0 


2.0 


L8 


2.0 


17.7 


3.9 


11.6 


2.5 


23 


2.4 


2.8 


2.7 


23.9 


9.0 


3-AP avg. 


40.2 


2.1 


2.0 


2.1 


2.5 


2.4 


852.6 


299.7 


19.8 


1.4 


1.4 


1.4 


1.6 


1.6 


79.4 


60.9 


19.9 


2.0 


1.9 


1.9 


2.4 


2.4 


22.4 


16.0 


4-AP avg. 


7.3 


1.5 


2.0 


1.9 


1.7 


2.2 


135.4 


5.1 


6.1 


1.0 


1.5 


1.5 


1.2 


1.7 


129.4 


3.4 


7.4 


1.9 


1.8 


1.8 


1.9 


2.1 


16.5 


5.0 


5-AP avg. 


2.3 


1.2 


1.2 


1.2 


1.4 


1.3 


121.8 


2.4 


2.1 


1.1 


1.1 


1.1 


1.1 


1.2 


263.8 


1.8 


2.2 


1.4 


1.3 


1.4 


1.6 


1.4 


14.1 


2.8 


6-AP avg. 


1.6 


1.0 


1.1 


0.9 


1.0 


1.0 


171.4 


1.6 


1.2 


0.9 


0.9 


0.9 


1.0 


0.8 


543.1 


1.2 


1.7 


1.1 


0.9 


1.0 


1.0 


1.0 


11.9 


1.3 


7-AP avg. 


0.5 


0.6 


0.5 


0.6 


0.4 


0.5 


167.9 


0.5 


0.5 


0.4 


0.4 


0.4 


0.4 


0.3 


800.9 


0.5 


0.7 


0.5 


0.2 


0.4 


0.5 


0.3 


10.3 


0.6 


8-AP avg. 


0.2 


0.1 


0.1 


0.1 


0.0 


0.2 


98.9 


0.1 


0.1 


0.2 


0.1 


0.2 


0.1 


0.1 


909.1 


0.2 


0.1 


0.2 


0.1 


0.2 


0.1 


0.1 


7.5 


0.2 
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Tab. 8: Multichain metaheuristic started from Trivial, Greedy and ROM. 10 seconds given. 1 — 2-opt, 2 
— 1DV, 3 — 2DV, 4 — sDV, 5 — 1DV 2 , 6 — 2DV 2 , 7 — sDV 3 , 8 — sDV v . 

Solution error, % 



Trivial Greedy ROM 



Inst. 


1 
1 


7 

Z 


7 
J 


4 


C 

J 


O 


n 
I 


Q 
O 


1 
1 


7 

z 


7 
J 


A 

4 


C 

J 


O 


7 


Q 
O 


1 


7 

z 


7 
J 


A 

4 


C 

J 





7 


Q 
O 


3gpl00 


11.2 


1.0 


1.0 


1.0 


1.1 


1.1 


2.5 


1.7 


5.3 


1.0 


1.0 


1.0 


1.1 


i.i 


2.8 


1.8 


9.7 


1.0 


0.9 


1.0 


1.2 


1.1 


2.3 


1.7 


3rl50 


65.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


41.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


33.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4gpJU 


2 9 


7 


7 


7 


7 


7 


7 


1 


2 6 


8 


7 


7 


7 


7 


7 


9 


2 1 


7 


7 


7 


7 
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Tab. 9: Heuristics comparison for the instances with independent weights. 

Inst. < 10 ms < 30 ms < 100 ms < 300 ms < 1000 ms 

C sDV 0.0 

C 2DV 2 0.0 

C sDV Gr 1.4 C sDV v 0.0 

3rl50 — C sDV 1.5 C sDV v 0.3 C sDV v Gr 0.0 (no better solutions) 

C 2DV 2 1.5 C sDV R 0.0 

C 2DV 2 R 0.0 

C sDV v R 0.0 



4r80 C 1DV 25.8 ? 5 ! sDV v Gr 1.5 C sDV v Gr 0.3 C sDV v Gr 0.0 

2DV 2 Gr 6. 1 



C sDV v 0.0 
C sDV v Gr 0.0 
C sDV v R 0.0 



2DV Gr 13.5 

5r40 lDV 2 Gr 15.0 sDV Gr 13.5 C sDV v 1.2 C sDV v 0.0 (no better solutions) 

2DV 2 Gr 13.5 

r ?nv 4fi 4 

6r22 C sDV 47 3 2-opt Gr 25.9 C sDV v Gr 1.4 C sDV v Gr 0.0 (no better solutions) 

C sDV v 0.0 

7rl4 C 2-opt Gr 28.6 C sDV v Gr 13.6 C sDV v 1.4 MC sDV v 0.0 (no better solutions) 

C sDV v Gr 0.0 

8r9 C 2-opt & 24 4 C sDV » 12 ' 2 C sDV - (no better solutions) (no better solutions) 



C sDV Gr 18.6 
C2DV 2 Gr 19.3 
C sDV 20.2 



Tola] C2E)Vj Cir 19.3 C sDV v Gr 4.8 C sDV v Gr 0.1 c Sv" Gr 
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Tab. 1 0: Heuristics comparison for the instances with decomposable weights. 



Inst. 



< 100 ms 



< 300 ms 



< 1000 ms 



< 3000 ms 



< 10000 ms 



3cql50 



3srl50 



4cq50 



sDV Gr 8.1 

C sDV Gr 9.6 

sDV Gr 9.8 

lDV 2 Gr 9.8 

C2DV 2 Gr 10.2 



C 1DV 
MC 1DV 
C 1DV 2 



9.7 
10.0 
10.3 



C sDV Gr 7.8 
C 2DV 2 Gr 7.8 



C sDV Gr 8.4 
C 2DV 2 Gr 8.4 



MC 1DV Gr 6.4 
MC 1DV 6.9 



MC sDV Gr 6.6 
MC2DV 2 Gr 7.1 



MC sDV Gr 3.1 
MC 2DV 2 Gr 3.4 



MC 1DV Gr 4.7 

MC 1DV 2 Gr 4.9 
MC 1DV 
MC sDV R 
MC 1DV 2 R 



5.0 
5.1 
5.1 



MC sDV Gr 



MC sDV Gr 6.6 MC sDV Gr 3.5 MC sDV Gr 



MC 1DV Gr 2.7 MC 1DV Gr 
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MC 1DV 
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12.2 
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8.3 



2.1 
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C 2DV 
C 2DV 2 R 
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1.7 
1.7 


MC sDV 
MC 2DV 


1.3 
1.3 


2.7 


MC 2DV 2 


1.3 




MC 1DV 2 Gr 


2.4 


MC 2DV Gr 


1.9 




MC 2DV Gr 


2.5 


MC 1DV Gr 


1.9 


3.2 


MC sDV Gr 


2.5 


MC sDV Gr 


2.0 




MC 1DV 


2.5 


MC 2DV 2 Gr 


2.0 




MC 2DV 2 Gr 


2.6 


MC 1DV 2 Gr 


2.0 


0.7 


C 2DV Gr 


0.3 


C sDV Gr 


0.0 


1.4 
1.5 


C 1DV 


0.8 


C sDV Gr 


0.3 



7cql2 

7srl2 
8cq8 



C 1DV 



C 1DV 
C 1DV 



C 1DV 



0.7 



1.2 
0.0 



0.3 



C 1DV 



C 1DV 
C 1DV, 

C 1DV 



C 1DV 
C 2DV 



0.2 



0.5 
0.5 



0.0 



0.0 
0.0 



C 1DV 2 



0.1 



C 1DV R 0.1 



C 1DV 



C 2DV 



0.0 



0.0 



C 1DV 
C2DV 2 
C 1DV Gr 
C 1DV 2 Gr 
C 1DV R 
C 2DV R 
C sDV R 
C 2DV 2 R 



0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 



(no better solutions) 



(no better solutions) (no better solutions) (no better solutions) 



C 1DV 
C 2DV 
C 1DV 2 
C2DV 2 
C 1DV Gr 
C 1DV 2 Gr 
C 2DV 2 Gr 
C 2-opt R 
C 1DV R 
C 2DV R 
C 1DV 2 R 
C 2DV 2 R 



0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 



(no better solutions) (no better solutions) 



Total 



C 1DV 



6.4 



C 1DV 
C 2DV 



4.5 
5.0 



MC 1DV 3.5 

MC 2DV 3.7 

C 2DV 3.7 

MC 1DV R 3.8 



MC 1DV Gr 1.9 

MC 2DV Gr 2.1 

MC sDV Gr 2.1 

MClDV 2 Gr 2.1 



MC 1DV Gr 



1.3 



